5 ms·
We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" No idea if/when we decide to pull that bandaid but I think onc
by beardedetim 1mo ago
We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?"
No idea if/when we decide to pull that bandaid but I think once we can't merge a hot fix into main because of GH being down, it'll be a big org push to replace it.
What's everyone else using? Self hosted Gitlab? Gitea?
- nerdypepper 1mo ago> What's everyone else using? Self hosted Gitlab? Gitea? tangled.org!
- classified 1mo agoI'm completely untangled. From GitHub.
- http-teapot 1mo agoWhat's your experience with tangled? Would love to hear the experience from other users as well
- MarkBennett 1mo agoIt's worked great for hosting my smaller personal projects so far, and I've already received a few helpful pull requests from the community. Tangled.org really been working to ensure all their features work from data hosted on your personal data server (it's based on ATproto) which means should their performance, reliability, or monetization ever get you down it's easy to switch to a competitor since you're not locked in.
- drno123 1mo agoSelf hosted Gitea
- newswasboring 1mo agoWhen you self host, what happens with your compute costs? CI can be super expensive depending upon your test pipeline. Do you end up spending more than you would with GitHub actions for example?
- Maxion 1mo agoHuh? The VPS boxes have a fixed monthly fee
- applidhumanco 1mo agoHe is likely referring to the CI runners. Gitea has their own version of Actions runner. It is very much usable, though currently inferior to GitHub Actions (not always a 1:1 replacement, even though they aim for it to be): https://docs.gitea.com/usage/actions/ https://docs.gitea.com/usage/actions/ Cost as always depends on your usage, but it will likely be less than your current cost of GitHub Actions.
- newswasboring 1mo agoThank you. This is exactly what I meant. I work for a large company where our testing budget is massive and most of it goes towards these CI runners. Provisioning enough and consistent compute for testing pipelines sometimes becomes the bane of my existence.
- Maxion 1mo agoI can recommend that you self-host Jenkins on another box.
- JoshStrobl 1mo agoJust get some x86 and ARM runners off netcup, manage Woodpecker CI + Woodpecker Agent. Generally pretty hands-off once you get it set up. That plus a cheap VPS running Forgejo with postgres off-site backups, you are looking at a small fraction of the cost compared to per-seat GitHub pricing for orgs + Action Minutes.
- elric 1mo ago> We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?" Did you have the conversation "do we need to move from $whatever CI/CD to GitHub Actions?" beforehand? What were the arguments in favour?
- beardedetim 1mo agoIt's a ~year old product that started on GH. So this is the first time this team has had to think through "okay, so this isn't as reliable as it was at $oldjob."
- Macha 1mo agoNot the same company but similar discussions here: - It was believed that GitHub would be more reliable than our self hosted Gitlab CI runners. This has proven to be very false. - It was believed it would be easier to write tooling. I’m not on the dev tooling team, so can’t confirm if they found it true or not, but from the outside I see a lot more “Github can’t do that” than I did “Gitlab can’t do it”
- Normal_gaussian 1mo agoThose are both hilarious to me. In my last FTE role we had the exact opposite beliefs - we wanted to leave GitLabs increases in pricing and move to annual sub, but the reliability of self-hosted runners and the flexibility (and clarity) of the CI system was fantastic.
- dataengineer56 1mo ago> Those are both hilarious to me. Why is it hilarious to believe that the industry leader might be better at something than doing it yourself?
- deleted 1mo ago[deleted]
- 1mo ago
- qweqwe14 1mo agoSelf-hosted GitLab and self-hosted GitLab Runners (Omnibus Docker image)
- lsuresh 1mo agoWe use self-hosted Github runners, but it's a moot point if all of Github is mostly down as is the case right now. :\
- c2403 1mo agoHave you considered Codeberg?
- sscaryterry 1mo agoDifferent set of ideologies completely, not an alternative.
- 6031769 1mo agoAn alternative set of ideologies is part of what makes it ... an alternative! I mean, that plus better uptime.
- Macha 1mo agoI remember in 2024 passing over codeberg as the host for some of my personal projects because of the uptime. I don’t think Codeberg’s uptime has gotten any better but despite that it’s getting a lead over GitHub now.
- sscaryterry 1mo agoIts about freedom, which codeberg are supposed to be proponents of. Turns out, they're no better than github :) See: https://blog.codeberg.org/protecting-our-floss-commons-from-llms.html https://blog.codeberg.org/protecting-our-floss-commons-from-...
- layer8 1mo agoSelf-hosted GitLab at work, self-hosted Gitea at home.
- speleding 1mo agoIf your app is not too large you can do CI/CD perfectly fine from your laptop. Put it in a docker container if you want to ensure it is perfectly reproducible. You still need Github as the origin repo to pull from, but the "git part" of GitHub seems to be (almost) always up and running. (We use "capistrano" for this)
- cesarb 1mo ago> If your app is not too large you can do CI/CD perfectly fine from your laptop. Not if you want to make sure it compiles and works on Windows (which you don't have) or macOS (which you don't have and can't emulate). That's something github gives for free, and for me, it's the only reason to stay on github for small/tiny free software projects (at least as a secondary host).
- latchkey 1mo agoblacksmith.sh just raised tens of millions on the core premise that self-hosting CI/CD is hard [0]. they've had multiple outages in the last week, so i guess they are proving themselves correct. in practice, giving ssh/sudo to AI (codex) and telling it to setup ephemeral self-hosted runners on your own host VM (qemu), takes about 30 minutes and works extremely well. it bangs out all the shell scripts. moved my own business over to it. zero problems. you might even find it is kind of neat too. you can customize your VM with software pre-installed. speeds up your builds quite a bit. [0] https://www.blacksmith.sh/blog/blacksmith-seed-announcement https://www.blacksmith.sh/blog/blacksmith-seed-announcement
- badgersnake 1mo agoTeamCity
- stephenway 1mo agoIf you're seriously looking at Gitea/Forgejo, I run Fjord, dedicated managed Forgejo, so you don't have to operate it yourself. We can help with migration and runners too. We also run a free public Forgejo instance if you just want to kick the tires first.
- pojntfx 1mo agoThank you for your work on Fjord! We're currently evaluating it vs. self-hosting, the comparison at https://fjord.sh/compare https://fjord.sh/compare has been very useful
- stephenway 1mo agoThat's really good to hear, thank you. If you run into anything that's unclear while comparing the two, I'd genuinely like to hear it. Happy to answer questions here too.
- dcan 1mo agoSelf hosted Gitlab at work with local runners
- mitchjj 1mo agoWorth being upfront with, I'm an employee, but; Buildkite. Frontier labs and global saas heavyweights run CI through us, plus a crop of open source tooling like Bazel, vLLM, Firecracker, Rails, Ray, Sorbet and Rust. Shopify, Uber, Airbnb, Canva stresstested the platform ten years ago for scaling issues. You need to take a little time to design upfront and take advantage of dynamically programmable primitives. It isn't the same ease/convenience as Actions. Bit more available though.
- tom1337 1mo agoHow would I be able to run my CI via Buildkite when I still host in GitHub and their API is down? We are currently already using self-hosted runners and they also don't work because either they aren't started by GitHub or can't download the code.
- maccard 1mo agoWe ran a mirror of our git repo on codecommit when things started to get really hairy, and pointed out CI to that instead of GitHub. It’s still a moving target though as we were using GitHub releases to publish to. We replaced that with an s3 bucket and mirrored _those_ to GH via actions, which had the added benefit of only failing when GitHub was down!
- maccard 1mo agoI want to second build kite - it’s an excellent piece of tech and is best described as “sane Jenkins” as a compliment. My only gripe is the pricing - it’s not designed for “small teams”. But I’d use it again in a heartbeat.
- mitchjj 1mo agoThis week we've released a free plan and overhauled the mid-tier; am keen to hear whether this alleviates the 'small team' pain against others in market
- 29d ago
- nerdypepper 1mo agoultimately, folks need to stop writing massive YAML files to define their builds. CI should schedule jobs, your build system should define them. my workflow files look like this: steps: name: Do the thing run: nix build .# at any point, if my CI is down or i need to switch or i need to run builds locally, i can do so trivially.
- Norfair 1mo agoNixCI does this but with a built-in cache ;) https://nix-ci.com/comparison/github-actions https://nix-ci.com/comparison/github-actions
- jon_adler 1mo agoMy CI runner just calls make targets, that can easily be run locally if needed.
- maccard 1mo agoThis is all well and good until you need a cache, or credentials, or to pass data between steps, or to parallelize across runners.
- jscd 1mo agoIt's not the most elegant thing ever, but I've been using (self-hosted) WoodpeckerCI and it's been dead simple. It doesn't have many bells and whistles, but honestly I think that's good. Forced me to put complex behavior in better systems as opposed to doing bash scripts in YAML.
- baconslices 29d ago>What's everyone else using? Self hosted Gitlab? Gitea? Self hosted github enterprise and runners.