Software Testing Engineer Career Matrices
Software Testing | ||||||
Test design (2020) | Not required | Designs simple functional test cases and checklists for individual features.
Some of test cases may be incomplete and inaccurate.
Has general understanding of test design techniques. | Including all requirements from previous proficiency scale.
Designs test cases and checklists for entire application components and majority of testing types. May miss some non obvious test cases or test case elements.
Applies mainly specification-based test design techniques (e.g. decision table, state transition, boundary value analysis, equivalence partitioning).
Predicts test case execution time (although may be with low level of precision), defines obvious environment and configuration-specific cases.
Possesses at least basic expertise with test management tools. | Including all requirements from previous proficiency scale.
Designs test cases and checklists for entire application components and majority of testing types. May miss some non obvious test cases or test case elements.
Applies mainly specification-based test design techniques (e.g. decision table, state transition, boundary value analysis, equivalence partitioning).
Predicts test case execution time (although may be with low level of precision), defines obvious environment and configuration-specific cases.
Possesses at least basic expertise with test management tools. | Including all requirements from previous proficiency scales.
Designs test cases and checklists for features with arbitrary level of complexity and involving all relevant testing types, although may rarely miss the corner cases.
Actively applies experience-based test design techniques (e.g. exploratory testing, orthogonal array, error guessing).
Can properly structure test cases on test suite level and distinguish regression test cases among others.
Test case execution time and effort estimates are accurate in majority of cases. Full proficiency with test management tools.
Test cases are complete, well-structured, easy to read and understand. | Including all requirements from previous proficiency scales.
Applies structure-based test design techniques (e.g. multiple condition, statement or path testing).
Test case execution time and effort estimates are fully accurate.
Understands "design for testability" and "design for test automation" methods applicable to the Software Under Test.
Application of complex combinatorial techniques in behavior-driven testing.
Covers rare, specific or very complex use cases during test design. Properly structures test cases on whole application level.
Applies advanced white-box testing techniques in test design: such as state transition testing, branch and condition coverage analysis, etc. |
Platform-specific testing skills (2020) | Possesses basic applications installing, uninstalling and updating skills for appropriate platform.
Understands on the basic level the differences between platform-specific configurations and can apply this knowledge for cross-configuration test execution. | Possesses basic applications installing, uninstalling and updating skills for appropriate platform.
Understands on the basic level the differences between platform-specific configurations and can apply this knowledge for cross-configuration test execution. | Including all requirements from previous proficiency scale.
Is familiar with user interaction design guidelines for respective platform. Possesses advanced applications installing, uninstalling and updating skills.
If foreseen by the platform, has knowledge on user accounts and purchases management.
Possesses at least partial expertise in collecting additional RCA or test data for respective platform, such as crash reports, resource usage, device information, etc.
Understands majority of differences between platform configurations and applies this knowledge for cross-configuration test execution and design.
Possesses at least high-level understand of platform architecture. | Including all requirements from previous proficiency scales.
Is fully proficient with platform versioning and user interaction design guidelines.
Possesses an expertise with emulating actors or behaviors required by test cases.
Is fully proficient in collecting additional RCA or test data for respective platform, such as crash reports, resource usage, device information, etc.
If applicable, can install / uninstall / upgrade the platform itself.
Is fully proficient with cross-configuration testing.
Possesses at least high-level understanding about application architectures for respective platforms, the platform architecture and platform-specific security aspects. | Including all requirements from previous proficiency scales.
Possesses an expertise with advanced aspects of target platform (e.g. accessing file system on mobile, working with platform-specific data storages, etc.)
Can apply debuggers, analytical or spying utilities for improving the efficiency of testing and RCA.
Is good with application architectures for respective platform, including majority of architectural aspects. | Including all requirements from previous proficiency scales, but applicable for at least two platforms. |
Test execution and reporting (2020) | Executes the tests of at least several test types on component level, although can miss some obvious issues or produce false positives ("not a bug").
Defect reports may still contain incomplete attributes or weak description.
Possesses at least theoretical issue tracking tools knowledge. | Executes the tests of at least several test types on component level, although can miss some obvious issues or produce false positives ("not a bug").
Defect reports may still contain incomplete attributes or weak description.
Possesses at least theoretical issue tracking tools knowledge. | Including all requirements from previous proficiency scale.
Executes the tests of majority testing types on component level. Possesses at least basic knowledge of integration testing. Rarely may miss functional issues and does not report FPs ("not a bug").
Defect reports contain at least minimum of required attributes. Uses simple productivity tools, such as screen-shooters.
Uses at least basic set of actions in issue tracking tools - creating / editing issues, commenting, searching and navigating issues through the workflow. | Including all requirements from previous proficiency scales.
Executes testing on component, integration and partially on system level. Proficient in all relevant testing types (including security and performance testing).
Does basic RCA, producing clear and useful defect reports (with crash logs, screenshots, video, software and hardware specifications).
Uses variety of productivity tools to improve performance and quality of testing (logging, debugging, etc.). Power user of issue tracking tools. | Including all requirements from previous proficiency scales.
Performs testing on all test levels. Familiar with security and performance testing basics. Rarely misses defects other than those that are difficult to reproduce or can't be reproduced repeatedly.
Defect reports are clear and laconic, containing all the relevant attributes.
Uses all kinds of relevant tools, such as virtual machines, simulators/emulators, debuggers or similar.
Is proficient with metrics and measurements, reflects them via appropriate tools (e.g. excel sheets and simple issue tracker boards). | Including all requirements from previous proficiency scales.
Executes testing with exceptional quality of defect detection.
Is proficient in improvement and optimization of issue tracking workflow.
Possesses an expertise in defining and applying testing metrics and can expose them through optimal presentation forms, including issue tracker dashboards, PPT, charts, graphs. |
Test planning and management (2020) | Not required | Not required | Familiar with the definition of Test Plan, general TP structure.
Able to process TP sections related to test execution (testing scope, testing coverage). | Familiar with the definition of Test Plan, general TP structure.
Able to process TP sections related to test execution (testing scope, testing coverage). | Including all requirements from previous proficiency scale.
Properly estimates test execution time and efforts.
Possesses basic impact analysis skills and uses them when planning test execution activities.
Is proficient in supporting and updating traceability matrices and testing guidelines. | Including all requirements from previous proficiency scales.
Produces fully accurate test execution time and effort estimates.
Able to define roles and responsibilities, project test schedule, test environment, test risks and contingencies, test acceptance criteria, create traceability matrix and define the testing guidelines.
Is proficient in selection of tools for test management (e.g. Zephyr, TestRail), issue tracking and other test activities.
Actively uses impact analysis techniques when planning test design and execution. |
Comments
Post a Comment