[Buildroot] [PATCH 00/10 v3] support/download: reproducible archives whatever tar version (branch yem/dl-git-tar-pax-2)
Yann E. MORIN
yann.morin.1998 at free.fr
Tue Dec 29 11:01:15 UTC 2020
Hello All!
This series fixes our download backends, git and svn, to generate
reproducible archives whatever the tar version, thus removing
the requirement for a maximum tar version.
This however changes the actual format of the generated archives,
and they are different from the existing ones. So we also change the
compression to avoid collision with existign archives on s.b.o, that
need to be read by older Buildroot versions.
A huge thank to Vincent for digging up the adequate set of options
that allow generating reproducible archives. Thanks! :-)
Note that this series contains commits marked "WIP": they are separate
commits for ease of review, but they should ultimately be squashed
together or the series would not be bisectable.
Changes v2 -> v3:
- drop support for per-site-method compression
- do not switch to compressing with xz
- move the tarball creation to a shared helper
Changes v1 -> v2:
- add support for internal numbering (Thomas)
Regards,
Yann E. MORIN.
----------------------------------------------------------------
Yann E. MORIN (10):
core/pkg-infra: prepare for alternate default source archives
core/pkg-infra: allow per site-method sub-version strings
support/download: add helper to generate a reproducible archive
WIP: support/download: change format of archives generated from git
WIP: boot+packages: update hash to new git-tarballs format
WIP: support/testing: update git-hash checks with new archive format
support/download: cleanup svn backend
support/download: change format of archives generated from svn
support/dependencies: drop check for maximal tar version
package/tar: drop specific version for host variant
boot/vexpress-firmware/vexpress-firmware.hash | 2 +-
package/aer-inject/aer-inject.hash | 2 +-
package/am33x-cm3/am33x-cm3.hash | 2 +-
package/armbian-firmware/armbian-firmware.hash | 2 +-
package/at/at.hash | 2 +-
package/azure-iot-sdk-c/azure-iot-sdk-c.hash | 2 +-
package/bayer2rgb-neon/bayer2rgb-neon.hash | 4 +-
package/brickd/brickd.hash | 4 +-
package/c-capnproto/c-capnproto.hash | 2 +-
package/dbus-triggerd/dbus-triggerd.hash | 2 +-
package/dt-utils/dt-utils.hash | 4 +-
package/dtv-scan-tables/dtv-scan-tables.hash | 6 +-
package/edid-decode/edid-decode.hash | 2 +-
package/ell/ell.hash | 2 +-
package/flashbench/flashbench.hash | 2 +-
package/fmc/fmc.hash | 2 +-
package/fmlib/fmlib.hash | 2 +-
.../imx-alsa-plugins/imx-alsa-plugins.hash | 2 +-
package/freescale-imx/imx-lib/imx-lib.hash | 2 +-
package/google-breakpad/google-breakpad.hash | 2 +-
.../gstreamer1/gst1-interpipe/gst1-interpipe.hash | 2 +-
package/gstreamer1/gst1-shark/gst1-shark.hash | 2 +-
package/imx-mkimage/imx-mkimage.hash | 4 +-
package/iwd/iwd.hash | 2 +-
package/kvm-unit-tests/kvm-unit-tests.hash | 2 +-
package/kvmtool/kvmtool.hash | 2 +-
package/libbroadvoice/libbroadvoice.hash | 4 +-
package/libcamera/libcamera.hash | 2 +-
package/libclc/libclc.hash | 4 +-
package/libg7221/libg7221.hash | 4 +-
package/libilbc/libilbc.hash | 4 +-
package/libsilk/libsilk.hash | 4 +-
package/libsvgtiny/libsvgtiny.hash | 4 +-
package/libuci/libuci.hash | 2 +-
package/libyuv/libyuv.hash | 4 +-
package/linux-firmware/linux-firmware.hash | 2 +-
.../linux-syscall-support.hash | 2 +-
package/minicom/minicom.hash | 2 +-
package/mmc-utils/mmc-utils.hash | 4 +-
package/net-tools/net-tools.hash | 2 +-
package/netcat-openbsd/netcat-openbsd.hash | 4 +-
.../netsurf-buildsystem/netsurf-buildsystem.hash | 2 +-
package/odhcp6c/odhcp6c.hash | 2 +-
package/opkg-utils/opkg-utils.hash | 2 +-
package/piglit/piglit.hash | 2 +-
package/pkg-download.mk | 5 ++
package/pkg-generic.mk | 3 +-
package/prelink-cross/prelink-cross.hash | 2 +-
package/psplash/psplash.hash | 4 +-
package/qoriq-rcw/qoriq-rcw.hash | 4 +-
package/qt-webkit-kiosk/qt-webkit-kiosk.hash | 2 +-
package/qt5/qt5coap/qt5coap.hash | 2 +-
package/qt5/qt5knx/qt5knx.hash | 2 +-
package/qt5/qt5mqtt/qt5mqtt.hash | 2 +-
package/rtc-tools/rtc-tools.hash | 4 +-
package/rtmpdump/rtmpdump.hash | 4 +-
package/speexdsp/speexdsp.hash | 4 +-
package/stm32flash/stm32flash.hash | 4 +-
package/tar/tar.mk | 8 +--
package/ti-sgx-demos/ti-sgx-demos.hash | 4 +-
package/ti-sgx-km/ti-sgx-km.hash | 2 +-
package/ti-sgx-um/ti-sgx-um.hash | 2 +-
package/trace-cmd/trace-cmd.hash | 6 +-
package/tremor/tremor.hash | 4 +-
package/ubus/ubus.hash | 2 +-
package/uclibc-ng-test/uclibc-ng-test.hash | 2 +-
package/uemacs/uemacs.hash | 4 +-
package/uhttpd/uhttpd.hash | 2 +-
package/ustream-ssl/ustream-ssl.hash | 4 +-
package/vboot-utils/vboot-utils.hash | 2 +-
package/wilink-bt-firmware/wilink-bt-firmware.hash | 4 +-
.../xdriver_xf86-video-imx-viv.hash | 2 +-
.../xdriver_xf86-video-intel.hash | 2 +-
support/dependencies/check-host-tar.sh | 14 +----
support/download/git | 31 ++++------
support/download/helpers | 70 ++++++++++++++++++++++
support/download/svn | 27 ++++-----
.../br2-external/git-hash/package/bad/bad.hash | 2 +-
.../br2-external/git-hash/package/good/good.hash | 2 +-
.../git-partial-sha1-branch-head.hash | 2 +-
.../git-partial-sha1-reachable-by-branch.hash | 2 +-
.../git-partial-sha1-reachable-by-tag.hash | 2 +-
.../git-partial-sha1-tag-itself.hash | 2 +-
.../git-partial-sha1-tag-points-to.hash | 2 +-
.../git-sha1-branch-head/git-sha1-branch-head.hash | 2 +-
.../git-sha1-reachable-by-branch.hash | 2 +-
.../git-sha1-reachable-by-tag.hash | 2 +-
.../git-sha1-tag-itself/git-sha1-tag-itself.hash | 2 +-
.../git-sha1-tag-points-to.hash | 2 +-
.../git-submodule-disabled.hash | 2 +-
.../git-submodule-enabled.hash | 2 +-
.../git-refs/package/git-tag/git-tag.hash | 2 +-
.../git-wrong-content/git-wrong-content.hash | 2 +-
93 files changed, 218 insertions(+), 168 deletions(-)
create mode 100755 support/download/helpers
--
.-----------------.--------------------.------------------.--------------------.
| Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ |
| +33 561 099 427 `------------.-------: X AGAINST | \e/ There is no |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. |
'------------------------------^-------^------------------^--------------------'
More information about the buildroot
mailing list