Lines Matching +full:test +full:- +full:only
9 # http://www.apache.org/licenses/LICENSE-2.0
26 def _output_mode_msg() -> str:
49 value: A string of a command-line argument.
77 '--minimal-build',
81 'Build required dependencies only (default: True). Use'
82 ' --no-minimal-build to disable it.'
86 '--update-device',
91 'Note, this feature currently only works for incremental device '
97 '--update:modules',
107 '-a',
108 '--all-abi',
113 '-b',
114 '--build',
121 '--bazel-mode',
127 '--no-bazel-mode',
133 '--bazel-arg',
138 ' --bazel-mode.'
144 '-d',
145 '--disable-teardown',
149 " if a test contains teardown logic without implementing TradeFed's"
151 " test phase then setting this flag won't prevent those cleanup steps"
157 '--code-under-test',
160 'Comma-separated list of modules whose sources should be included in'
162 ' included. For use with the --experimental-coverage flag.'
167 '--experimental-coverage',
176 '--group-test',
180 'Group tests by module name during the test run (default: True). To'
182 ' `--no-group-test`'
186 '--no-group-test',
190 'Group the tests by module name for running the test, if you want'
191 ' to run the test using the same input order, use --no-group-test.'
197 '--host',
200 'Run the test completely on the host without a device. (Note:'
201 ' running a host test that requires a device without --host will'
206 '--device-only',
209 'Only run tests that require a device. (Note: only workable with'
210 ' --test-mapping.)'
215 '-i',
216 '--install',
223 '-m',
227 'Forces a rebuild of the module-info.json file. This may be'
228 ' necessary following a repo sync or when writing a new test.'
232 '--sharding',
240 '--sqlite-module-cache',
246 '-t',
247 '--test',
252 'Run the tests. WARNING: Many test configs force cleanup of device'
253 ' after test run. In this case, "-d" must be used in previous test'
254 ' run to disable cleanup for "-t" to work. Otherwise, device will'
255 ' need to be setup again with "-i".'
259 '--use-modules-in',
261 'Force include MODULES-IN-* as build targets. Hint: This may solve'
262 ' missing test dependencies issue.'
267 '-w',
268 '--wait-for-debugger',
270 help='Wait for debugger prior to execution (Instrumentation tests only).',
275 '--request-upload-result',
278 'Request permission to upload test result. This option only needs'
279 ' to set once and takes effect until --disable-upload-result is'
284 '--disable-upload-result',
287 'Turn off the upload of test result. This option only needs to set'
288 ' once and takes effect until --request-upload-result is set'
294 '-p',
295 '--test-mapping',
300 '--host-unit-test-only',
305 '--include-subdirs',
309 # TODO(b/146980564): Remove enable-file-patterns when support
310 # file-patterns in TEST_MAPPING by default.
312 '--enable-file-patterns',
319 '--collect-tests-only',
322 'Collect a list test cases of the instrumentation tests without'
327 '--dry-run',
335 '-L', '--list-modules', help='List testable modules of the given suite.'
338 '-v',
339 '--verbose',
344 '-V', '--version', action='store_true', help='Display version string.'
347 '--build-output',
359 '--acloud-create',
365 '--start-avd',
373 '-s', '--serial', action='append', help='The device to run the test on.'
377 '--test-config-select',
380 'If multiple test config belong to same test module pop out a'
386 '--instant',
391 " it's not an Instant App test and '--instant' is passed."
395 '--user-type',
397 '(For module parameterization) Run test with specific user type,'
398 ' e.g. atest <test> --user-type secondary_user'
402 '--annotation-filter',
411 '-c',
412 '--clear-cache',
414 help='Wipe out the test_infos cache of the test and start a new search.',
417 '-D',
418 '--tf-debug',
426 '--tf-template',
429 'Add extra tradefed template for ATest suite, e.g. atest <test>'
430 ' --tf-template <template_key>=<template_path>'
434 '--test-filter',
438 # TODO(b/326141263): TradeFed to support wildcard in include-filter for
441 'Run only the tests which are specified with this option. This value'
448 '--test-timeout',
452 'Customize test timeout. E.g. 60000(in milliseconds) represents 1'
459 '--iterations',
466 '(For iteration testing) Loop-run tests until the max iteration is'
471 '--rerun-until-failure',
483 '--retry-any-failure',
497 '--latest-result', action='store_true', help='Print latest test result.'
500 '--history',
504 'Show test results in chronological order(with specified number or'
516 '--aggregate-metric-filter',
525 '--perf-itr-metrics',
531 '--no-checking-device',
533 help='Do NOT check device availability. (even it is a device test)',
537 '-j',
538 '--build-j',
547 '--use-tf-min-base-template',
557 '--',
561 'Specify custom args for the test runners. Everything after -- will'
570 …- A command line tool that allows users to build, install, and run Android tests locally, greatly …
574 atest [OPTION]... [TEST_TARGET]... -- [CUSTOM_ARGS]...
581 …E.g. Assume "--all-abi" and "--verbose" are frequently used and have been defined line-by-line in …
583 atest hello_world_test -v -- --test-arg xxx
587 atest hello_world_test -v --all-abi --verbose -- --test-arg xxx
589 If you only need to run tests for a specific abi, please use:
590 atest <test> -- --abi arm64-v8a # ARM 64-bit
591 atest <test> -- --abi armeabi-v7a # ARM 32-bit
593 …using Atest from testing TEST_MAPPING file and implicit test names from ~/.atest/config, any test …
598 - - - - - - - - -
600 - - - - - - - - -
602 …you'd like to run. Multiple tests can be run in one command by separating test references with spa…
606 …<reference_to_test> can be satisfied by the test's MODULE NAME, MODULE:CLASS, CLASS NAME, TF INTEG…
611 …g a test by its module name will run the entire module. Input the name as it appears in the LOCAL_…
613 Note: Use < TF INTEGRATION TEST > to run non-module tests integrated directly into TradeFed.
622 …test by its class name will run just the tests in that class and not the whole module. MODULE:CLAS…
645 < TF INTEGRATION TEST >
647 …To run tests that are integrated directly into TradeFed (non-modules), input the name as it appear…
651 atest native-benchmark
656 …Both module-based tests and integration-based tests can be run by inputting the path to their test…
660 Example - 2 ways to run the `CtsJankDeviceTestCases` module via path:
667 …Example - run a specific class within CtsJankDeviceTestCases module from <android repo> root via p…
670 Example - run an integration test from <android repo> root via path:
683 - - - - - - - - - - - - - - - - - - - - - - - - - -
685 - - - - - - - - - - - - - - - - - - - - - - - - - -
687 …-b, -i and -t options allow you to specify which steps you want to run. If none of those options a…
689 Note: -i alone is not currently support and can only be included with -t.
690 Both -b and -t can be run alone.
693 atest -b <test> (just build targets)
694 atest -t <test> (run tests only)
695 atest -it <test> (install apk and run tests)
696 atest -bt <test> (build targets, run tests, but skip installing apk)
699 …test to skip its cleanup/teardown step. Many tests, e.g. CTS, cleanup the device after the test is…
701 atest -d <test> (disable installing apk and cleaning up device)
702 atest -t <test>
704 …Note that -t disables both setup/install and teardown/cleanup of the device. So you can continue t…
706 atest -t <test>
711 - - - - - - - - - - - - -
713 - - - - - - - - - - - - -
715 …It is possible to run only specific methods within a test class. To run only specific methods, ide…
729 - - - - - - - - - - - - -
731 - - - - - - - - - - - - -
732 …It is possible to run only the tests that are specified by a custom filter, although not all test …
735 atest <TestModuleName> --test-filter <test.package.name>.<TestClass>#<testMethod>
738 atest ParameterizedHelloWorldTests --test-filter '.*HelloWorldTest#testHa.*'
740 …Note: parametrized JarHostTests can only be filtered by a specific method if parameters are also p…
741 …atest <TestModuleName> --test-filter <test.package.name>.<ParameterizedTestClass>#<testMethod>[<pa…
743 - - - - - - - - - - - - -
745 - - - - - - - - - - - - -
751 - two classes in same module:
754 - two classes, different modules:
758 - - - - - - - - - - -
760 - - - - - - - - - - -
762 Atest can run native test.
765 - Input tests:
766 atest -a libinput_tests inputflinger_tests
768 …Use -a|--all-abi to run the tests for all available device architectures, which in this example is…
770 …ive test to run, use colon (:) to specify the test name and hashtag (#) to further specify an indi…
774 You can run the entire test using:
778 or an individual test method using:
783 - - - - - - - - - - - - - -
785 - - - - - - - - - - - - - -
787 …To run tests in iterations, simply pass --iterations argument. No matter pass or fail, atest won't…
790 atest <test> --iterations # 10 iterations(by default).
791 atest <test> --iterations 5 # run <test> 5 times.
798 - 10 iterations(by default).
799 atest <test> --rerun-until-failure
800 - stop when failed or reached the 20th run.
801 atest <test> --rerun-until-failure 20
806 - 10 iterations(by default).
807 atest <test> --retry-any-failure
808 - stop when passed or reached the 20th run.
809 atest <test> --retry-any-failure 20
812 - - - - - - - - - - - -
814 - - - - - - - - - - - -
819 - Start an AVD before running tests on that newly created device.
821 acloud create && atest <test>
825 atest <test> --start-avd
827 … - Start AVD(s) by specifying 'acloud create' arguments and run tests on that newly created device.
829 …atest <test> --acloud-create "--build-id 6509363 --build-target aosp_cf_x86_phone-userdebug --bran…
831 To know detail about the argument, please run 'acloud create --help'.
834 …* --acloud-create must be the LAST optional argument: the remainder args will be consumed as its p…
835 …* --acloud-create/--start-avd do not delete newly created AVDs. The users will be deleting them ma…
838 - - - - - - - - - - - -
839 TESTS IN TEST MAPPING
840 - - - - - - - - - - - -
849 atest --test-mapping </path/to/project>
852 2) Run a specified test group in TEST_MAPPING files.
859 atest --test-mapping </path/to/project>:postsubmit
861 atest --test-mapping </path/to/project>:mainline-presubmit
866 …only search for tests in TEST_MAPPING files in current (or given directory) and its parent directo…
869 atest --include-subdirs [optional </path/to/project>:<test_group_name>]
871 …t to search for tests in a given directory, with optional test group name. By default, the test gr…
874 - - - - - - - - - - - - - -
876 - - - - - - - - - - - - - -
878 When trying to pass custom arguments for the test runners, everything after '--'
882 atest -v <test> -- <custom_args1> <custom_args2>
885 atest <test> -- --module-arg <module-name>:<option-name>:<option-value>
886 …atest GtsPermissionTestCases -- --module-arg GtsPermissionTestCases:ignore-business-logic-failure:…
889 atest <test> -- --test-arg <test-class>:<option-name>:<option-value>
890 …atest CtsVideoTestCases -- --test-arg com.android.tradefed.testtype.JarHosttest:collect-tests-only…
893 2022-03-25