Get Gentoo!
gentoo.org sites
gentoo.org Wiki Bugs Forums Packages
Planet Archives Sources
Infra Status
summaryrefslogtreecommitdiff
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Bulk WIP commit for Robin.Alec Warner2022-01-0910-0/+0
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add code for ago's stuff.Alec Warner2021-02-132-0/+321
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add PoC for milter.Alec Warner2019-08-092-0/+159
| | | | | | | TODO: rcpt_to likely needs some canonicalization (lists.g.o vs g.o, some other stuff. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add target pool for our loadbalancer.Alec Warner2019-08-091-1/+12
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Update description.Alec Warner2019-08-091-0/+1
| | | | | | | Terraform wants to recreate the network to wipe the description and we do not want that. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add a default network to make firewall happy.Alec Warner2018-12-271-0/+5
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add firewall rule.Alec Warner2018-12-271-1/+10
| | | | | | Tag our rsync nodes and add a firewall rule to allow tcp/873. Signed-off-by: Alec Warner <antarus@gentoo.org>
* gce-container... not gcs.Alec Warner2018-12-271-1/+1
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Refactor rsync to add autoscaler and mig.Alec Warner2018-12-272-15/+25
| | | | | | The container spec is still causing some trouble. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Fix syntax in container spec.Alec Warner2018-12-271-1/+1
| | | | | | I pulled the REST and merged it. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Fixup container spec.Alec Warner2018-12-271-1/+1
| | | | | | | | Use :prod container. Mark privileged. Rename to rsync-4 Signed-off-by: Alec Warner <antarus@gentoo.org>
* Strip the IP so we can auto-allocate an IP.Alec Warner2018-12-271-1/+0
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Start of terraform config.Alec Warner2018-12-272-0/+71
| | | | | | Main and Rysnc template. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Reserve enough inodes in the tmpfs.Alec Warner2018-12-171-2/+2
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Fully Qualify paths.Alec Warner2018-12-161-3/+3
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Serve from /srv/gentoo/serving.Alec Warner2018-12-161-1/+1
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Don't shadow the tree with our tmpfs mount.Alec Warner2018-12-161-6/+8
| | | | | | | The previous instance would mount the tmpfs over our two created tmpdirs causing our tmpdirs to be unavailable and causing a failure. Signed-off-by: Alec Warner <antarus@gentoo.org>
* GCP wants "1300m" not "1.3g" for tmpfs size.Alec Warner2018-12-161-1/+1
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Don't remount the tmpfs, just mount it.Alec Warner2018-12-161-1/+1
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Support logging to stackdriver.Alec Warner2018-12-161-2/+3
| | | | | | | | | | | Currently the "logger -t" lines in wrap_rsync.sh do get caught by the logs collector, but the rsync logs do not because /var/log/rsync.log is not configured to be collected by default. Configure rsync to log to /var/log/syslog, which is automatically parsed and streamed to stackdriver. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Attempt to fit a node on a 1.7GB g1-small on GCP.Alec Warner2018-12-161-0/+10
| | | | | | | | | | | | | | rsync basically takes like no resources to run; we hope. Most of our real servers are doing this with like 1-2 CPUs and 2GB of memory. So align that with our vm sizing. The g1-small is a 1.7GB memory container with 1 shared vcpu. Allocate 1.3GB of memory to the tmpfs. This should house 2 rsync trees (clocking in at 590MB a piece). Further work with hardlinks can likely reduce the size even more. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Various rsync node improvements.Alec Warner2018-12-153-25/+64
| | | | | | | | | | | | | | | | | | | | | WAIT_TIME=30m to test in production. Move content to /srv/gentoo. On GCP we need to explicitly declare a tmpfs (we are advised not to re-use /dev/shm). In the Dockerfile, explicitly make /srv/gentoo and try to make a tmpfs there. Sync directly from Turnstone, because its fast at syncing and more reliable than rsync.us.gentoo.org. Remove --checksum from args as it causes some mirrors to fail. Log with logger -t so logs get sent to stackdriver on gcp. Disable chroot; it doesn't seem to work with Containers on GCE. Signed-off-by: Alec Warner <antarus@gentoo.org>
* Add Robin's ha-proxy bits for non-cloud LB.Alec Warner2018-12-093-1/+85
| | | | | | | | This supports denying syncing when busy / out of date and an rsync friendly deny message; similar to http 429 (TOO_BUSY) or 503 (SERVICE_UNAVAILABLE.) Signed-off-by: Alec Warner <antarus@gentoo.org>
* Try to get more atomic syncing for serving content.Alec Warner2018-12-091-12/+18
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Ensure WORKDIR exists.Alec Warner2018-12-031-0/+3
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Initial commit of rsync docker stuff.Alec Warner2018-12-038-56/+263
| | | | Signed-off-by: Alec Warner <antarus@gentoo.org>
* Start tracking tools for tracking members.Alec Warner2016-10-186-0/+240