Commit graph

62 commits

Author SHA1 Message Date
Igor Pečovnik
bf544c21f8
Display additional info to build log 2021-01-29 21:41:35 +01:00
Igor Pecovnik
4a986a8787 Backend - move version upgrade to separate functionality 2021-01-29 21:04:46 +01:00
Igor Pecovnik
b10b0454a5 Set image compression levels to maximum
This feature is used mainly by us or other distributors. An internal function. Compression time and CPU usage for this process is significantly increased but the size of the daily batch was decreased from 80Gb -> 50Gb. Mitigate upload speed bottleneck.
2020-12-22 12:54:04 +01:00
Igor Pecovnik
666ac0bc5e Buildall - tiny fix 2020-11-22 12:04:13 +01:00
Igor Pečovnik
3ddd91de71
Add several small improvements for building all images (#2365)
* Add several improvements for build all images / kernels
* More small fixes
* Adjust version
2020-11-22 08:54:41 +01:00
Igor Pečovnik
a78eaa5aaf
Improve creating images from repository (#2340)
* Few cosmetic changes and updated configs
* Improve repository install
* Update configs
* Adjust configs
2020-11-14 19:29:39 +01:00
Igor Pecovnik
37b50f154a Bugfix related to firmware creation 2020-11-12 19:46:47 +01:00
Igor Pečovnik
694b2313dd
Cosmetical: exchange mv with rsync (#2329)
* Cosmetical: exchange mv with rsync

Also make build script output less chatty to console. Show SD and mount size % only.

* Leave output here
2020-11-11 19:25:51 +01:00
Piotr Szczepanik
c43c4e9cbd Add SPI flash boot support to rockchip64/rk3399 2020-10-17 23:38:05 +02:00
Igor Pečovnik
1275f118e2
Change desktop cache name, add support for automated cached creation / switching (#2257) 2020-10-16 15:25:15 +02:00
Igor Pečovnik
448484f6d8
Change Ubuntu Eoan to Ubuntu Groovy and enable it as CSC (#2254)
* Change Ubuntu Eoan to Ubuntu Groovy and enable it as CSC

Tested CLI and desktop image, but needs cache creation and repository before it will be possible to build without error.

* Update Groovy compiler for chroot

* Adjust pkg dependencies for groovy

Sadly htop doesn't build
2020-10-14 22:50:11 +02:00
Igor Pecovnik
43896d5891 Bugfix for backend operations 2020-10-14 14:53:35 +02:00
Igor Pečovnik
e8f961c9c7
Mitigate git server failures by retrying git commands several times. (#2251)
* Mitigate git server failures by retrying git commands several times.
* Bugfix - commit type was not working at all. Now it works
2020-10-14 08:36:21 +02:00
Igor Pecovnik
668e764357 Backend - split upstream changes to beta and stable 2020-10-04 16:55:11 +02:00
Igor Pecovnik
ebd9524041 Internals - build all / improve hash checking 2020-09-23 00:26:50 +02:00
Igor Pecovnik
704277e136 Internal - supressing errors when directory for hasing is not present 2020-08-31 17:36:30 +02:00
Igor Pecovnik
5a6af1e761 Internal functions fixing
- improve HASH creation
- checking if BUMP_VERSION is set to YES
2020-08-31 17:27:23 +02:00
Igor Pecovnik
3676dfaeb5 Adding new internally used variable BUMP_VERSION 2020-08-31 17:03:56 +02:00
Piotr Szczepanik
6c8b9d9371
Unset MODULES and MODULES_BLACKLIST vars before next build in BUILD_ALL (#2162)
* Unset also MODULES and MODULES_BLACKLIST vars before next build

* Document MODULES and MODULES_BLACKLIST
2020-08-28 18:45:25 +02:00
Igor Pecovnik
3a5b572c0f Improve multithreaded building, few changes for BUILD_ALL and removing debug code from MOTD 2020-08-18 22:31:07 +02:00
Igor Pecovnik
501e033b70 Cosmetic. Suppress error when creating a hashes 2020-08-15 17:31:22 +02:00
Igor Pečovnik
939241f484
Bugfix for build all 2020-08-10 12:28:25 +02:00
Igor Pečovnik
0c46b4c1d2
Add support for packages remove per board or family (#2128) 2020-08-04 16:16:02 +02:00
Igor Pecovnik
74483bc629 Improve / fix building images directly from repository 2020-08-03 20:25:34 +02:00
Igor Pečovnik
9123037db2
bugfix 2020-07-29 20:05:36 +02:00
Igor Pečovnik
a2d756dace
Add support for two dedicated package lists for BOARD and FAMILY (#2097)
* Add support for two dedicated package lists for BOARD and FAMILY

- PACKAGE_LIST_BOARD
- PACKAGE_LIST_FAMILY

* Add some info about recently added features to the README.md
2020-07-17 18:29:24 +02:00
Igor Pecovnik
92dca11e1d Move mvebu 64 to 5.7.y, add few kernels to build target, improve git changes checking 2020-06-28 12:15:23 +02:00
Igor Pečovnik
7d758026b5
Enable kernel boot splash, env and bootscript files cleanup, upstream patches (#2065)
* Initial commit for kernel boot splash
* Add startup files to disable bootlog when system is up / down
* Update logo, remove deprecated one
* Introduce new u-boot variable bootlogo
* Adjust kernel config
* Make logo possible on Odroid XU4
- add legacy and current upstream patches
- delete xu4 environment since its not used
* Cleanup C2,C4, both tested, logo works on mainline,
- adding legacy upstream patches for c4
* Enable bootlogo by default on Odroid N2
* Enable logo on RK3399 desktop images
* Cleanup the rest of the environment files
* Add initrd hook that copy splash file to initrd.
* Missing logo bits for one boot scripts
* Enable boot logo on Pinebook A64
* Enable bootlogo on Teres
* Update config
2020-06-27 19:14:38 +02:00
Igor Pečovnik
204e1ccd7a
Add missing variable (#2066) 2020-06-25 17:58:18 +02:00
Igor Pecovnik
57aed22fc8
More shellcheck fixes
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-24 17:22:04 +02:00
Manuel Rüger
752f4ddc7e
lib/build-all-ng.sh: Fix mistakes with shellcheck linting (#2052)
* lib/build-all-ng.sh: Fix mistakes with shellcheck linting

* Update build-all-ng.sh

Co-authored-by: Igor Pečovnik <igorpecovnik@users.noreply.github.com>
2020-06-23 20:04:30 +02:00
Manuel Rüger
b3c75bdfb8
Shellcheck fixes2 (#2049)
* distributions.sh: Lint via shellcheck

* chroot-buildpackages.sh: Lint via shellcheck

* build-all-ng.sh: Lint via shellcheck
2020-06-23 10:15:13 -04:00
Igor Pecovnik
355a306301
[Backend] Few improvements to the build-all
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-20 20:49:03 +02:00
Igor Pecovnik
b9730fe0e2
Small fixes
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-19 17:32:43 +02:00
Igor Pecovnik
4762ec2302
Add some delay to not kill build server
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-18 21:42:55 +02:00
Igor Pečovnik
213a5a6855
Enabling IGNORE_UPDATES back (#2036) 2020-06-18 20:21:00 +02:00
Igor Pecovnik
273fb7dea4
Automation related bugfix
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-18 17:26:15 +02:00
Igor Pecovnik
dc478af1cb
Bugfix when making all kernels, also enable building of sunxi-legacy
Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-06-18 15:49:27 +02:00
Igor Pecovnik
d9770e2a86
[CI actions] Also watch kernel changes in kernel configuration 2020-06-17 13:36:48 +00:00
Igor Pečovnik
fda0e22951
Improve all kernel building (#2017)
* Improve all kernel building

Store hashes and rebuild only changed kernels. TBD: support for patch directory not fully implemented yet

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Add support for patch directory checking

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Update lib/build-all-ng.sh

Co-authored-by: Manuel Rüger <manuel@rueg.eu>

* Update lib/build-all-ng.sh

Co-authored-by: Manuel Rüger <manuel@rueg.eu>

* Update lib/compilation.sh

Co-authored-by: Manuel Rüger <manuel@rueg.eu>

* Update lib/compilation.sh

Co-authored-by: Manuel Rüger <manuel@rueg.eu>

* Update build-all-ng.sh

* Disable u-boot hashing for now

* remove banana r2

breaks compilation ... no time for inspection ATM

* typo

* Change s5p6818 to COMMIT instead of TAG

TAG points to a different HASH and its not posible to resolve hash without cloning. This can be addressed later, but now commit HASH will do.

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Bumping to new version

* Bumping to new version

* Bump

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* few changes

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Test

* Bumping to new version

* Bumping to new version

BOARD
Cubox i2eX/i4

* Bumping to new version

imx6 current
meson-gxl current

* Bumping to new version

linux-image-current-imx6_20.08.4-trunk_armhf.deb
linux-image-current-meson64_20.08.4-trunk_arm64.deb

* Bumping to new version

Adding following kernels:\n

* Bumping to new version

Adding following kernels:

linux-image-current-imx6_20.08.4-trunk_armhf.deb
linux-image-current-meson64_20.08.4-trunk_arm64.deb

* Bumping to new version

Adding following kernels:

linux-image-current-meson64_20.08.5-trunk_arm64.deb
linux-image-current-sunxi_20.08.5-trunk_armhf.deb
linux-image-legacy-meson_20.08.5-trunk_armhf.deb
linux-image-legacy-s5p6818_20.08.5-trunk_arm64.deb

* fix versioning

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Bumping to new version

Adding following kernels:

linux-image-current-meson64_20.08.1_arm64.deb

* Put version back

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Bumping to new version

Adding following kernels:

linux-image-current-imx6_20.08.0-trunk_armhf.deb
linux-image-current-meson64_20.08.0-trunk_arm64.deb
linux-image-current-mvebu_20.08.0-trunk_armhf.deb
linux-image-current-mvebu64_20.08.0-trunk_arm64.deb
linux-image-current-odroidxu4_20.08.0-trunk_armhf.deb
linux-image-current-rockchip_20.08.0-trunk_armhf.deb
linux-image-current-rockchip64_20.08.0-trunk_arm64.deb
linux-image-current-sunxi_20.08.0-trunk_armhf.deb
linux-image-dev-mvebu_20.08.0-trunk_armhf.deb
linux-image-dev-rockchip64_20.08.0-trunk_arm64.deb
linux-image-legacy-meson_20.08.0-trunk_armhf.deb
linux-image-legacy-meson64_20.08.0-trunk_arm64.deb
linux-image-legacy-mvebu_20.08.0-trunk_armhf.deb
linux-image-legacy-mvebu64_20.08.0-trunk_arm64.deb
linux-image-legacy-odroidxu4_20.08.0-trunk_armhf.deb
linux-image-legacy-rk3399_20.08.0-trunk_arm64.deb
linux-image-legacy-rockchip_20.08.0-trunk_armhf.deb
linux-image-legacy-rockchip64_20.08.0-trunk_arm64.deb
linux-image-legacy-rockpis_20.08.0-trunk_arm64.deb
linux-image-legacy-s5p6818_20.08.0-trunk_arm64.deb

* Bumping to new version

Adding following kernels:

* Bumping to new version

Adding following kernels:

linux-image-dev-rockchip_20.08.0-trunk.2_armhf.deb

* Bumping to new version

Adding following kernels:

* Bumping to new version

Adding following kernels:

* Bumping to new version

Adding following kernels:

* Bumping to new version

Adding following kernels:

* Report error code, adjust version

* Adjust ver

* Add another switch

Co-authored-by: Manuel Rüger <manuel@rueg.eu>
Co-authored-by: root <root@workstation>
2020-06-17 11:38:17 +02:00
Igor Pečovnik
ca67855553
Add GPT partition table support (#2015)
* Add GPT parition table support               Leave unchanged / mbr by default since GPT doesn't works everywhere.

* Accept ROOTFS_PARTITION_TABLE as a parameter

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Change variable name

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>

* Update README.md
2020-06-14 23:03:58 +02:00
The-going
dcc6e791da
Offlinework (#2019)
* Delete FORCE_CHECKOUT, IGNORE_UPDATES variables

There are currently two questionable variables.
They are the keys in the structures:
'if [[ $FORCE_CHECKOUT == yes ]]; then' in the function 'fetch_from_repo()'
which is set by default by the script 'main.sh'
'[[ -z $FORCE_CHECKOUT ]] && FORCE_CHECKOUT=yes'

Next in the script 'main.sh'

if [[ $IGNORE_UPDATES != yes ]]; then
    display_alert "Downloading sources" "" "info"
    fetch_from_repo "$BOOTSOURCE" "$BOOTDIR" "$BOOTBRANCH" "yes"

This key has aged. It can't work properly today.
We should always clear the sources before starting the build.
For this reason, these two keys in these places do not make any sense.
You can just delete them.

* Working offline for sources

This is useful when building recursively for multiple platforms,
when some resource on the Internet is frozen.
To do this, I entered a new variable 'OFFLINE_WORK'

* New ability to work in offline mode

* Skip check prepare host
* Add unset OFFLINE_WORK in lib/build-all-ng.sh

Sources, time and host will not be checked
Now you can collect packages without accessing the Internet
2020-06-14 22:58:02 +02:00
Igor Pečovnik
0832201958
Rework of image signing. (#1995)
* Rework of image signing. We compress the image first, then signing and shaing that.

Based on @belfastraven work https://github.com/belfastraven/build/blob/pre-new-doc/lib/debootstrap.sh

* Uncompressed images can be removed

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-05-28 15:52:44 +02:00
Igor Pecovnik
53e4bc2d38
Armbian firmware recreation and image upload bugfix
Cleaning was improper in case of retries

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-05-19 17:43:48 +02:00
Igor Pečovnik
26d377cd2a
Adding new feature REPOSITORY_INSTALL (#1933)
* Rework packages install that they can be installed from repository instead of local compile. Handy for making releases.
* Don't build ATF if you don't build u-boot
2020-05-10 14:36:22 +02:00
Igor Pecovnik
e57aaf6556 Internal switch - make the same nightly images as for stable one. For making RC targets. 2020-05-10 12:21:21 +02:00
Igor Pecovnik
25eff65004 Add variables to build-all 2020-05-06 21:50:48 +02:00
Igor Pečovnik
4fe804b399
Enabling Ubuntu 20.04 and Debian 11 build targets (#1872) 2020-04-05 22:25:15 +02:00
Igor Pecovnik
3479b590e0
Improve images uploading
Select faster SSH chiper to speed up a bit

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-04-04 22:30:22 +02:00
Igor Pecovnik
b607b666b3
Improve XZ compression support
Cleanup after upload, download scripts also supports this format

Signed-off-by: Igor Pecovnik <igor.pecovnik@gmail.com>
2020-04-04 21:04:34 +02:00