Vulkan CTS 1.4.0.0

New Tests:
 * Tests for VK_EXT_device_generated_commands
 * Rename video decode tests to extract codec name as new group
 * Test VIEW_INDEX_FROM_DEVICE_INDEX_BIT with GPL
 * Support for raytracing pipeline libraries in Amber
 * Add coverage for depth bound test without depth attachment
 * Expand dual_blend tests for secondary fragment outputs
 * Run creation_feedback tests for pipeline binaries
 * Add test cases for 256 bytes PushConstantsSize
 * Two additional tests for local read
 * Rename video encode tests to extract codec name as new group
 * MSAA Images in 64 bit Atomic + Shader Storage Images
 * Run pipeline cache tests for pipeline binaries
 * Reuse scratch buffer creating acceleration structures back-to-back
 * Add a test for modf with whole numbers < 0
 * Add coverage for multiple queue submits
 * Test preemption with VK_KHR_global_priority
 * Add coverage for waiting on multiple events
 * Remove non-mandatory line rasterization features
 * Test feedback loop with dynamic rendering local read
 * Test drawing with stencil test and without vkCmdSetFrontFace
 * Update to new VkPipelineBinaryKeyKHR definition
 * Tests for VK_EXT_legacy_vertex_attributes
 * Remove isSkippedPixel from derivative tests
 * Test pipeline without render pass or VkPipelineRenderingCreateInfo
 * Initial implementation Ray Tracing support in Amber
 * Additional VIEW_INDEX_FROM_DEVICE_INDEX_BIT tests
 * Remove extended_usage_bit_compatibility with image_format_list tests
 * Tests for dedicated device memory overallocation.
 * hevc decode: add scaling list tests
 * SPV_EXT_replicated_composites
 * Test binaryCount of 0 in VkPipelineBinaryInfoKHR structure
 * Suballocated DRM images
 * Test image usage with format features
 * Add pipeline binaries case for ray tracing
 * Enable tests for storage texel buffer atomic
 * Add tests for VK_EXT_legacy_dithering revision 2
 * Update vk1.4 features to include pushDescriptor
 * Check if pipeline binary key count is greater than 0
 * Handle new dynamic rendering local read properties
 * Remove some of FDM + DRLR tests
 * Add more tests for fmin/fmax with +/-0
 * Add test cases for maxPushConstantsSize queried from device
 * Test line rasterization parameters do not affect non-lines
 * Test new pipeline binary functionality
 * Removed ESO compute tests using Amber
 * Test DRLR remapping while using shader object
 * Modify pipeline state tests to only set necessary states
 * Remove redundant pipelines from Image Atomic tests
 * Add shader object tests using all stages with nextStage 0
 * Add tests for subgroup uniform descriptor indexing
 * Add tests for draw count clamping with null index buffer
 * Add R8 and R16 large image tests in host image copy test group
 * Capture replay tests for VK_EXT_descriptor_buffer
 * Added tests for VK_EXT_depth_clamp_control
 * Add tests vkCmdDrawIndexedIndirectCount draw count clamping
 * Tests for VK_KHR_compute_shader_derivatives

Fixes:
 * Fix pipeline_robustness out_of_bounds_stride test
 * Add feature checks to conditional rendering tests
 * Fix memory leak in pipeline logic op tests
 * Fix NV-DGC conditional rendering preprocess tests
 * Fix sync issues in copy and blit tests
 * Fix enabling sync2 in video synchronization tests
 * Build fixes for Visual Studio (2022)
 * Add void extent ASTC tests
 * Fix missing memory barriers in a deqp-vk test.
 * Fetch Vulkan 1.4 properties and resize image layouts earlier
 * Allow starting helper invocations in maximal reconvergence tests
 * video: remove obsolete define ES_STATIC_COMPILATION
 * Fix pipeline binary graphics tests
 * Add missing dependencies for decode h265 + maintenance1 tests
 * Fix multiple pipeline stat query tests
 * Fix crash in local read max input attachments test
 * Fix pNext chain loop in FSR tests
 * Check vk1.4 required limits
 * Remove non-mandatory vertex attribute divisor feature
 * Fix errors in unavailable_entry_points test
 * Fix mixed usage of custom creations and defaults from context
 * Test local read without mapping
 * Don't access out-of-bounds per-vertex attributes
 * Test binding VK_NULL_HANDLE to unsupported mesh shader stages
 * Fix setting scissor in shader object scissor tests
 * Remove invalid dynamic rendering local read tests
 * Test pipeline using compatible render pass without resolve attachment
 * Test mismatched dimensionality
 * Add precise occlusion query feature check
 * Add missing VK_KHR_compute_shader_derivatives.json file
 * Fix size in vkGetDescriptorEXT in descriptor buffer tests
 * Fix handling of DRLR property for two tests
 * Use correct features/properties queries
 * Test setting pColorAttachmentInputIndices to NULL
 * Fix spirv error in fp16 tests
 * Check fillModeNonSolid before using non-solid fill modes
 * Check shaderSignedZeroInfNanPreserveFloat16 depending on shaderFloat16
 * Fix transform feedback simple tests cleanup
 * Check limits before running mapping_to_large_index DRLR test
 * Revert "Test mismatched dimensionality"
 * Use Amber fix for dealing with null optional function pointers (ie. vkCreateRayTracingPipelinesKHR)
 * Check shader cache file is not NULL before closing it
 * Add missing linked shader object test case
 * Remove multi-line test results in DRM format modifier tests
 * Fix EXT-DGC conditional rendering preprocess tests
 * Fix custom device used in nonsequential tests
 * Enable vertexPipelineStoresAndAtomic in pipeline state tests
 * bresenhamLines is mandatory for Vulkan 1.4
 * Fix using wrong device in bind_buffers_2 tests
 * Fix enabling sync2 in video synchronization tests
 * Fix lack of failure conditions in DRM format modifier tests
 * Fix checking of mandatory features
 * Clear 2d_view_of_3d images on the same command buffer as the test
 * Fix VK_PIPELINE_CREATE_VIEW_INDEX_FROM_DEVICE_INDEX_BIT tests
 * Remove mandatory feature checks from consistency tests
 * Fix entry_points test
 * Add R64 data format qualifier check in robustness tests
 * Move a mandatory feature case to autogen
 * Correct mandatory features for Vulkan 1.4
 * Add a NotSupportedChecker to keyed mutex tests
 * Correct vk1.4 partialy promoted feature checks
 * Fix 'unused shader' message
 * Fix waiver mechanism for Vulkan SC testing

Improvements:
 * Default --deqp-terminate-on-device-lost to enable
 * Allow running the CTS with unknown versions of Vulkan in the driver
 * Pull in Vulkan 1.4 Amber support
 * Fix framework and properties tests for vk1.4
 * Add option to enable/disable spir-v validation
 * Add option to enable/disable duplicate case name check
 * Avoid spamming logs on infra errors
 * Framework and util changes for pipeline binaries
 * Change virtual ... = DE_NULL; to virtual ... = 0;
 * Use VulkanSC Loader by default in deqp-vksc
 * Make VK_NULL_HANDLE strongly typed

Other:
 * Use the Vulkan 1.4 environment for SPIR-V validation
 * Re-enable video tests on Android for CMake based builds
 * Reformat JSON extension files automatically
 * Allow fetch_sources.py to properly stop with Ctrl+C
 * Update SPIRV-Tools, SPIRV-Headers, glslang, Vulkan-Docs, Vulkan-ValidationLayers external sources
 * Change virtual ... = DE_NULL; to virtual ... = 0; (Part 2)
 * Fix error in test logging in all CtsDeqpTestCases
 * Remove DE_NULL's definition
 * Remove DE_NULL from C files
Merge vk-gl-cts/vulkan-cts-1.3.10 into vk-gl-cts/vulkan-cts-1.4.0

Change-Id: I1feef73b5f47ed0548aeb08fe1089fa002780db5
tree: 2776c3ca4c3cd1df4fc8ee77e44b78a9b4fa7b97
  1. .github/
  2. android/
  3. data/
  4. doc/
  5. execserver/
  6. executor/
  7. external/
  8. framework/
  9. modules/
  10. scripts/
  11. targets/
  12. .clang-format
  13. .editorconfig
  14. .gitattributes
  15. .gitignore
  16. AndroidGen.bp
  17. AndroidKhronosCTSGen.bp
  18. CMakeLists.txt
  19. CODE_OF_CONDUCT.md
  20. deqp_binary.lds
  21. format_all.sh
  22. LICENSE
  23. METADATA
  24. MODULE_LICENSE_APACHE2
  25. NOTICE
  26. OWNERS
  27. README.md
README.md

VK-GL-CTS README

This repository contains Khronos Conformance Testing Suite called VK-GL-CTS which originated from dEQP (drawElements Quality Program). VK-GL-CTS contains tests for several graphics APIs, including OpenGL, OpenGL ES, EGL, Vulkan, and Vulkan SC.

Documentation

Up-to-date documentation for VK-GL-CTS is available at:

The .qpa logs generated by the conformance tests may contain embedded PNG images of the results. These can be viewed with scripts/qpa_image_viewer.html, by opening the file with a web browser and following its instructions, or using the Cherry tool.

Khronos Vulkan Conformance Tests

This repository includes Khronos Vulkan CTS under external/vulkancts directory. For more information see Vulkan CTS README.

Khronos OpenGL / OpenGL ES Conformance Tests

This repository includes Khronos OpenGL / OpenGL ES CTS under external/openglcts directory. For more information see OpenGL / OpenGL ES CTS README.

Selecting a subset of targets to build by default

When configuring the source code of VK-GL-CTS for running either Vulkan Conformance Tests or OpenGL(ES) Conformance Tests as described above, CMake will generate build files that, by default on desktop platforms, will build every possible project binary. This may be undesirable due the amount of time and disk space needed to perform the build.

One way of selecting only a subset of the targets to be built is using CMake's target selection mechanism. For example, the following command will only build deqp-vk, the main Vulkan Conformance Tests binary:

cmake --build BUILD_DIRECTORY --target deqp-vk

When building only a subset of targets is the preferred default behavior for a given working copy or build directory, there's a second target selection mechanism that can be used to avoid passing the --target option every time: the SELECTED_BUILD_TARGETS CMake option. If set to a non-empty value, only the targets listed in that configuration option, separated by spaces, will be built.

For example, passing -DSELECTED_BUILD_TARGETS="deqp-vk deqp-vksc" when configuring the project will make cmake --build BUILD_DIRECTORY act as if it had been passed --target deqp-vk --target deqp-vksc as additional arguments.

IMPORTANT: Target subset selection may not have been thoroughly tested in all enviroments and situations, and it does not replace the instructions given for the purposes of creating a conformance submission.

ANGLE for Android

ANGLE can be built for Android by following the instructions here.

The resulting ANGLE shared object libraries can be linked against and embedded into dEQP.apk with the --angle-path option. This will cause dEQP.apk to use the ANGLE libraries for OpenGL ES calls, rather than the native drivers.

An ABI must be specified and the directory structure containing the ANGLE shared objects must match it so the build system can find the correct *.so files.

Assuming ANGLE shared objects are generated into ~/chromium/src/out/Release/ and dEQP.apk will be generated with --abis arm64-v8a, issue the following commands:

cd ~/chromium/src/out/Release/
mkdir arm64-v8a && cd arm64-v8a
cp ../lib*_angle.so .

The --angle-path ~/chromium/src/out/Release/ option can then be used to link against and embed the ANGLE shared object files. The full command would be:

python scripts/android/build_apk.py --sdk <path to Android SDK> --ndk <path to Android NDK> --abis arm64-v8a --angle-path ~/chromium/src/out/Release/