summaryrefslogtreecommitdiff
path: root/bin
AgeCommit message (Collapse)AuthorFilesLines
2023-08-03bin/pick-ui: use venv wrapperEric Engestrom2-0/+12
Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24367>
2023-08-03bin/ci/update_traces_checksum: use venv wrapperEric Engestrom1-0/+10
Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24367>
2023-08-03bin/ci/gitlab_gql: use venv wrapperEric Engestrom1-0/+10
Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24367>
2023-08-03bin/ci/ci_run_n_monitor: use venv wrapperEric Engestrom1-0/+10
Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24367>
2023-08-03bin: add wrapper to run scripts in a python venvEric Engestrom1-0/+27
This isolates the script environment from the rest of the machine, avoiding missing/incompatible dependencies and avoiding polluting the rest of the machine with python packages. Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24367>
2023-08-03bin/ci: handle errors more gracefully in update_traces_checksum scriptDavid Heidelberg1-1/+1
UnicodeDecodeError is present very often, since GitLab logs are scary. Signed-off-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24444>
2023-07-28bin/ci_run_n_monitor: get git sha from pipeline if specified, instead of ↵Eric Engestrom1-10/+15
requiring --rev to match Fixes: 9ce717ab31f24faf0a15 ("ci_run_n_monitor: add ability to specify the pipeline to use, instead of auto-detecting it") Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24366>
2023-07-17bin/ci: Ensure that all jobs have nodes in DAGGuilherme Gallo1-10/+15
Some automatic jobs, such as 'rustfmt' and 'clang-format', are skipped during the graph sweep because their parents are already included in the node set. This commit ensures all visited jobs are in DAG and fixes iteration modification using deepcopy. Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/9376 Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com> Acked-by: David Heidelberg <david.heidelberg@collabora.com> Reviewed-by: Eric Engestrom <eric@engestrom.ch> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24176>
2023-06-15bin/pick-ui: use asyncio.new_event_loopDylan Baker1-1/+1
Instead of .get_event_loop, which is deprecated when there isn't a running loop (like in our case). Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23472>
2023-06-15bin/pick: Add support for adding notes on patchesDylan Baker2-4/+66
This is pretty useful for keeping track of why a patch isn't landed, or who I'm waiting on feedback from. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23472>
2023-06-15bin/pick: use lineboxes to make the UI clearerDylan Baker1-2/+2
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23472>
2023-06-15bin/pick: fix issue where None for nomination_type could failDylan Baker1-6/+5
We have an assumption it's never None, so use a special value in the Enum instead. Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23472>
2023-06-02ci: Respect $HTTP_PROXY for ci_run_n_monitorDaniel Stone1-1/+2
We need to explicitly tell AIOHTTP that it's OK to take the HTTP proxy from the environment. Signed-off-by: Daniel Stone <daniels@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23341>
2023-05-28bin/ci: mention requirements.txtDavid Heidelberg3-0/+3
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22078>
2023-05-26bin/ci: fix mistakenly hardcoded repo name in get_gitlab_project()Eric Engestrom1-1/+1
It didn't matter so far because all callers always pass "mesa". Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23223>
2023-05-26ci_run_n_monitor: add ability to specify the pipeline to use, instead of ↵Eric Engestrom1-4/+22
auto-detecting it The auto-detection code currently looks for a repo called "mesa" in the current user's fork (ie. the user providing the api token), which is great for the common use case, but sometimes needs to be able to be overridden, such as when running a pipeline in another fork than one's own, when working with someone else in their fork. Signed-off-by: Eric Engestrom <eric@igalia.com> Acked-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23230>
2023-05-10ci: bump bin/ci/ deps to support python 3.11Eric Engestrom1-2/+2
Signed-off-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22943>
2023-04-19bin/ci: Add StructuredLogger to improve log handlingGuilherme Gallo2-0/+476
This commit introduces the StructuredLogger module, which provides a robust and flexible logging utility supporting multiple data formats (CSV, JSON, and YAML). By incorporating this module into our CI system, we enhance our log management capabilities, making it easier to: 1. Monitor and analyze logs: The StructuredLogger is a dict-like data abstraction which autosaves into a structured data file, whenever it is updated. With this file, one can easily know specifics of the job execution without having to grep it in the traces logs or exploring the job artifacts. The autosave feature makes it useful even when the CI job fails unexpectedly, since the partial dict is always written back to the disk. 2. Maintain data integrity: The module includes context managers for file locking and editing log data, ensuring data integrity and preventing race conditions. 3. Support multiple formats: With built-in support for CSV, JSON, and YAML formats, this module caters to a wide range of use cases and user preferences. 4. Increase maintainability: The modular design of the StructuredLogger and its corresponding strategies simplifies maintenance and allows for seamless integration of additional formats in the future. Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
2023-03-30bin: Fix typosHarri Nieminen9-13/+13
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22189>
2023-03-30docs: use version-number as toctree-title for relnotesErik Faye-Lund1-2/+3
Using the full titles makes most of these take up two lines in the toctree. The version number is really the only thing we should care about, though. Reviewed-by: Marcin Ślusarz <marcin.slusarz@intel.com> Reviewed-by: Eric Engestrom <eric@igalia.com> Cc: mesa-stable Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21956>
2023-03-10symbols-check: support OSes based on GNU toolchainPino Toscano1-1/+1
Some of the symbols listed in PLATFORM_SYMBOLS are not only specific to Linux, but rather specific to the GNU toolchain. Hence, use them when inspecting ELF binaries produced by a GNU toolchain: this means on Hurd ('GNU'), and on e.g. kFreeBSD ('GNU/kFreeBSD'). Signed-off-by: Pino Toscano <toscano.pino@tiscali.it> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21825>
2023-03-06ci/ci_run_n_monitor: while we usually disable many jobs, print them inlineDavid Heidelberg1-1/+2
Saving scrolling time... Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com> Signed-off-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21713>
2023-02-23docs: mention `meson configure` and drop broken workaround scriptEric Engestrom1-63/+0
The script is broken, and nobody noticed so it wasn't used much. Meson has had support for printing the options by pointing to the source dir for a while (not sure the exact version though) so I think we can just recommend users do that. Signed-off-by: Eric Engestrom <eric@engestrom.ch> Reviewed-by: Yonggang Luo <luoyonggang@gmail.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21469>
2023-01-25android: Make libbacktrace optional againTomeu Vizoso1-0/+28
For the same reason why we used to have USE_LIBBACKTRACE with the old Android makefiles, allow to build Mesa without linking to it. In recent VNDK versions, libbacktrace isn't available. When building without linking libbacktrace, for some reason some symbols related to C++ exception handling are exposed. Allow them in the symbols check script. Signed-off-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> Signed-off-by: Helen Koike <helen.koike@collabora.com> Reviewed-by: Sergi Blanch Torné <sergi.blanch.torne@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20019>
2023-01-19meson: use builtin support for reading version from a fileDylan Baker1-39/+0
In meson 0.57 support was added for reading a version from a file to meson natively, so we don't need this workaround anymore. Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20752>
2023-01-16bin/ci: add gitlab_gql.py.cache to the .gitignoreEric Engestrom1-1/+1
On my machine, the filecache doesn't have the extra `.db` suffix, just `.cache`. Signed-off-by: Eric Engestrom <eric@engestrom.ch> Reviewed-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20722>
2023-01-12gen_release_notes: include links in relnotes.rst when generating the new ↵Eric Engestrom2-31/+29
release note This is required to allow the docs to build, which in turn is required if we want to allow merge requests against release (staging) branches. Cc: mesa-stable Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20460>
2023-01-12gen_release_notes: allow using the script from another checkoutEric Engestrom1-3/+3
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20459>
2023-01-12gen_release_notes: avoid crashing when none of the commits mention closing ↵Eric Engestrom1-1/+4
an issue Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20459>
2023-01-12gen_release_notes: stop the script if we can't generate the release noteEric Engestrom1-0/+1
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20459>
2023-01-06ci_run_n_monitor.py: automatically retry on transient errorsEric Engestrom1-1/+3
This morning a GitLab update was deployed, leading to a few moments where the API returned an error. python-gitlab is actually able to handle a number of those and retry automatically, so let's enable that: https://python-gitlab.readthedocs.io/en/stable/api-usage-advanced.html#transient-errors Signed-off-by: Eric Engestrom <eric@engestrom.ch> Reviewed-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20094>
2022-12-30bin/gen_release_notes.py: read Closes/Fixes tags case-insensitivelyKonstantin Kharlamov2-2/+13
Cc: mesa-stable Signed-off-by: Konstantin Kharlamov <Hi-Angel@yandex.ru> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20241>
2022-12-30bin/gen_release_notes.py: parse "Fixes" tags as well as "Closes"Konstantin Kharlamov2-14/+31
Some commits refer to bugs being fixed with "Fixes" tag. Example of one: e13d53e1fdb 'Revert "glx/dri: Fix DRI drawable release at MakeCurrent time"' Parse this tag as well. Cc: mesa-stable Signed-off-by: Konstantin Kharlamov <Hi-Angel@yandex.ru> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20241>
2022-12-30bin/gen_release_notes.py: don't fail if "Closes" refers to an MRKonstantin Kharlamov2-1/+21
Sometimes a tag "Closes:" in a commit may refer to a merge request instead of an issue. Examples of such commits: 34319c7d84 "ci/freedreno: disable antichambers trace" 998122d9c2 "mesa: fix GL_INVALID_OPERATION in glEGLImageTargetTexStorageEXT" Avoid failing on these by explicitly checking that the URL refers to an issue Cc: mesa-stable Signed-off-by: Konstantin Kharlamov <Hi-Angel@yandex.ru> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20241>
2022-12-30bin/gen_release_notes.py: do not fail on confidential featuresKonstantin Kharlamov1-1/+6
A commit may refer to an issue marked as confidential. That will look like a 404 page for outside users. One example of such commit is: 369c12e5be "anv: clear descriptorsets if AllocateDescriptorSets fails" Let's handle that case. Cc: mesa-stable Signed-off-by: Konstantin Kharlamov <Hi-Angel@yandex.ru> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20241>
2022-12-30bin/gen_release_notes.py: do not end "features" with "None"Konstantin Kharlamov1-3/+1
Currently, the "New features" list unconditionally ends with a "None" point, which makes no sense. The original author probably meant to check whether the file is empty, so remove the else clause, and add the check for emptiness. Cc: mesa-stable Signed-off-by: Konstantin Kharlamov <Hi-Angel@yandex.ru> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20241>
2022-12-29gen_release_notes: strip second newline in new featuresEric Engestrom1-1/+1
Signed-off-by: Eric Engestrom <eric@engestrom.ch> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20132>
2022-12-19ci: move the CI handling scripts into bin/ciDavid Heidelberg9-0/+909
Any change in .gitlab-ci/ directory triggers an entire CI run, which is unnecessary for just changing the developers' scripts. Added symlink to `.gitlab-ci/bin` to keep original invocation compatibility. Reviewed-by: Martin Roukala <martin.roukala@mupuf.org> Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com> Signed-off-by: David Heidelberg <david.heidelberg@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20371>
2022-11-30commit_in_branch.py: variables cleanupEric Engestrom2-32/+30
Signed-off-by: Eric Engestrom <eric@engestrom.ch> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19988>
2022-11-30commit_in_branch.py: add support for checking staging branchesEric Engestrom2-3/+7
Or any branch that contains a `/` slash. Cc: mesa-stable Signed-off-by: Eric Engestrom <eric@engestrom.ch> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19988>
2022-11-30commit_in_branch.py: fix testsEric Engestrom1-2/+2
Apparently these were backported since I wrote these tests ^^ Signed-off-by: Eric Engestrom <eric@engestrom.ch> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19988>
2022-11-22meson: do not use source_root() when possibleDanylo Piliaiev1-1/+6
source_root() function is deprecated in Meson version 0.56.0 because it returns the source root of the parent project if called from a subproject. Why would anyone need Mesa as a meson subproject? It would be used as subproject in a project generated by command buffer "decompiler" for Freedreno. Signed-off-by: Danylo Piliaiev <dpiliaiev@igalia.com> Reviewed-by: Eric Engestrom <eric@igalia.com> Reviewed-by: David Heidelberg <david.heidelberg@collabora.com> Acked-by: Rob Clark <robdclark@chromium.org> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19901>
2022-11-18scripts: Fix khronos-update.py to use main for OpenCL headersJason Ekstrand1-18/+19
Also, cl.hpp no longer exists in OpenCL-Headers to fix it at the last commit where it did exist. Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19816>
2022-11-11meson: fixes mingw-clang32 buildingYonggang Luo2-14/+16
Cc: mesa-stable Signed-off-by: Yonggang Luo <luoyonggang@gmail.com> Reviewed-by: Jesse Natalie <jenatali@microsoft.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19610>
2022-11-11meson: Refactoring shared gen_vs_module_defs_normal_command outYonggang Luo1-0/+5
Cc: mesa-stable Signed-off-by: Yonggang Luo <luoyonggang@gmail.com> Reviewed-by: Jesse Natalie <jenatali@microsoft.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/19610>
2022-08-21bin/perf-annotate-jit.py: Update to Python 3.Vinson Lee1-3/+3
Signed-off-by: Vinson Lee <vlee@freedesktop.org> Reviewed-by: Eric Engestrom <eric@igalia.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/12926>
2022-08-09egl: Remove eglextchromium.h and import eglext_angle.hYonggang Luo1-2/+1
The upstream eglextchromium.h in https://chromium.googlesource.com/chromium/src/+/refs/heads/master/ui/gl/EGL/eglextchromium.h are broken, so remove it and using eglext_angle.h instead. By running "python bin/khronos-update.py egl" to update EGL files, then discard changes other than eglext_angle.h Signed-off-by: Yonggang Luo <luoyonggang@gmail.com> Reviewed-by: Eric Engestrom <eric@igalia.com> Reviewed-by: Adam Jackson <ajax@redhat.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/17815>
2022-08-03bin/gen_release_notes.py: bump advertised vulkan version to 1.3Eric Engestrom1-1/+1
Fixes: df8ac77af8093c87d5d5 ("anv: Advertise Vulkan 1.3") Fixes: 08c6f437cf63234f4a5d ("radv: advertise Vulkan 1.3") Signed-off-by: Eric Engestrom <eric@igalia.com> Reviewed-by: Jordan Justen <jordan.l.justen@intel.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/17759>
2022-05-02bin: Add a script for filtering/sorting refcount logsJesse Natalie1-0/+78
Reviewed-by: Sil Vilerino <sivileri@microsoft.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/16182>
2022-04-19win32: Fixes 32 bits visual studio module definition files by add script ↵Yonggang Luo2-0/+99
gen_vs_module_defs.py Getting opengl32*.def consistence with Windows SDK. Getting osmesa.mingw.def's gl* functions consistence with Windows SDK. stw_* functions are cdecl, not stdcall, so there is no need mangling the symbol. Fixes egl.def for x86 d3d10sw: Move the place of d3d10_sw.def to d3d10_sw.def.in Fixes vulkan_lvp.def for x86 Fixes #5552 Remove stdcall-fixup Signed-off-by: Yonggang Luo <luoyonggang@gmail.com> Reviewed-by: Jesse Natalie <jenatali@microsoft.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/14041>