Veganism Social

1 post1 participant0 posts today

HabrОбщие подходы к классическому PostgreSQL в KubernetesХабр, привет! Меня зовут Алексей Быков, и я занимаюсь развитием Cloud-native платформы для обработки данных Arenadata One в компании Arenadata. Современные высоконагруженные системы требуют гибкого масштабирования и отказоустойчивости для обеспечения стабильной производительности в условиях постоянно растущих объёмов данных. Когда речь идёт о PostgreSQL, развёрнутом в Kubernetes, перед инженерами встают особые вопросы: как упорядочить реплики для отказоустойчивости, каким образом настроить бэкапы и мониторинг, а главное — как корректно масштабироваться в облачной среде. В этой статье мы рассмотрим, почему «ванильный» PostgreSQL в контейнерной среде может работать ненадёжно и какие механизмы применяются сегодня, чтобы сделать базу данных по-настоящему Cloud Native. Разберём ключевые аспекты классических инсталляций Postgres, проанализируем, в чём заключаются основные сложности их переноса в Kubernetes. Монолит в облаке?!<a href="https://habr.com/ru/companies/arenadata/articles/894610/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://habr.com/ru/companies/arenadata/articles/894610/</a><a href="https://zhub.link/tags/postgresql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#postgresql</a> <a href="https://zhub.link/tags/kubernetes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#kubernetes</a> <a href="https://zhub.link/tags/k8s" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#k8s</a> <a href="https://zhub.link/tags/cloud_native" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cloud_native</a> <a href="https://zhub.link/tags/patroni" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#patroni</a> <a href="https://zhub.link/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> <a href="https://zhub.link/tags/neon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#neon</a> <a href="https://zhub.link/tags/backup" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#backup</a> <a href="https://zhub.link/tags/%D0%B0%D0%B4%D0%BC%D0%B8%D0%BD%D0%B8%D1%81%D1%82%D1%80%D0%B8%D1%80%D0%BE%D0%B2%D0%B0%D0%BD%D0%B8%D0%B5_%D0%B1%D0%B0%D0%B7_%D0%B4%D0%B0%D0%BD%D0%BD%D1%8B%D1%85" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#администрирование_баз_данных</a> <a href="https://zhub.link/tags/%D0%BF%D0%BE%D1%81%D1%82%D0%B3%D1%80%D0%B5%D1%81" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#постгрес</a>

Carsten Rieger IT-Services 🔒<a href="https://digitalcourage.social/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> v.3 InstallationsanleitungMit Hilfe unserer Installationsanleitung für den HAProxy Version 3 stable (LTS) können Sie beispielsweise zwei verschiedene Cloud-Anwendungen parallel betreiben und diese mit LetsEncrypt Zertifikaten versorgen. Wir nutzen dafür einen Mixed Mode, also Layer 6 (http) und Layer 4 (tcp für https) in der HAProxy-Konfiguration. Der HAProxy agiert dabei als klassischer ReverseProxy und kann auf Wunsch auch zum Loadbalancer erweitert werden. Nachfolgend stellen wir dafür unsere HAProxy-Konfiguration aus dem Labor bereit. Diese nutzen wir bspw. für unsere Cloud-Testinstanzen (bspw. <a href="https://digitalcourage.social/tags/Nextcloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Nextcloud</a> und <a href="https://digitalcourage.social/tags/opencloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#opencloud</a> auf einem dedizierten Server. Die SSL-Terminierung übernimmt dabei das jeweilige Backend, also Nextcloud und OpenCloud und nicht der HAProxy selbst. Der HAProxy reicht die https-Anfragen an die Anwendung durch und agiert im tcp-Mode (Layer 4) quasi transparent. 👇 <a href="https://www.c-rieger.de/haproxy-installationsanleitung/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.c-rieger.de/haproxy-installationsanleitung/</a>

✰ 𝔽𝕣𝕖𝕕 ✰<a href="https://mamot.fr/users/ploum" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@ploum@mamot.fr</a> i am also using it <a href="https://social.freebsd.amsterdam?t=snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> <a href="https://social.freebsd.amsterdam?t=haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a>

✰ 𝔽𝕣𝕖𝕕 ✰do you have anything in between <a href="https://social.freebsd.amsterdam?t=snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> and <a href="https://social.freebsd.amsterdam?t=haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a>? I am currently unable to find a way to get rid of the <pre># webfinger location /.well-known/webfinger { proxy_pass http://localhost:8001; proxy_set_header Host $http_host; proxy_set_header X-Forwarded-For $remote_addr; } </pre>and the like in <a href="https://social.freebsd.amsterdam?t=nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nginx</a>

✰ 𝔽𝕣𝕖𝕕 ✰great work! Looking forward to a (speedy) blog posting Is there no other service between <a href="https://social.freebsd.amsterdam?t=snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> and <a href="https://social.freebsd.amsterdam?t=haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> ?

Stefano MarinelliI've performed some tests, and it's great. <a href="https://mastodon.bsd.cafe/tags/snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> and <a href="https://mastodon.bsd.cafe/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> are working great together - now with caching of media and json responses, to scale up, and up, and up...and up! <a href="https://mastodon.bsd.cafe/tags/Varnish" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Varnish</a> is the best tool for caching, but the setup I've tested doesn't require it and it's still good enough. I think this will be a blog post, as soon as I'll have enough time.<a href="https://mastodon.bsd.cafe/tags/snac2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac2</a> <a href="https://mastodon.bsd.cafe/tags/Fediverse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Fediverse</a> <a href="https://mastodon.bsd.cafe/tags/IT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IT</a> <a href="https://mastodon.bsd.cafe/tags/SysAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SysAdmin</a>

Stefano MarinelliGoing on with <a href="https://fedihome.stefanomarinelli.it?t=haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> in front of <a href="https://fedihome.stefanomarinelli.it?t=snac2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac2</a> - I've just tested an interesting caching for json response. This will surely help instances like FediMeteo. It's not struggling, but I love optimizing stuff!

Koen de Jonge - SynQI just unfollowed <a href="https://procolix.social/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> from Twitter, but it seems they are not here on the Fediverse.A pity, I will miss them.<a href="https://procolix.social/tags/eXit" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#eXit</a>

Stefano MarinelliI was thinking about how it was possible to stop using a gem like HAProxy for so long. It used to be my go-to choice, but then I switched to using Nginx for everything, and I almost forgot about it. Well, it’s great to reconnect with old friends! <a href="https://mastodon.bsd.cafe/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> <a href="https://mastodon.bsd.cafe/tags/Nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Nginx</a> <a href="https://mastodon.bsd.cafe/tags/SysAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SysAdmin</a>

computing competenceBericht KW11:- MO: Urlaub - DI: Rollout <a href="https://mastodon.online/tags/3CX" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#3CX</a> - MI: Unternehmerfrühstück <a href="https://mastodon.online/tags/netzwerken" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#netzwerken</a> Diverses <a href="https://mastodon.online/tags/vpn" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#vpn</a> <a href="https://mastodon.online/tags/Updates" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Updates</a> - DO: Diverses <a href="https://mastodon.online/tags/OPNsense" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OPNsense</a> Regeln angepasst. <a href="https://mastodon.online/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> mit <a href="https://mastodon.online/tags/acme" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#acme</a> Umstellung von <a href="https://mastodon.online/tags/NAT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NAT</a>. Netzwerkberatung - FR: Bürotag. <a href="https://mastodon.online/tags/ActiveDirectory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ActiveDirectory</a> Fehlersuche. <a href="https://mastodon.online/tags/OPNsense" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OPNsense</a> Firewall im HA-Cluster ausgerolltHighlight: <a href="https://mastodon.online/tags/OPNsense" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OPNsense</a> HA-Cluster sind ein Traum. <a href="https://mastodon.online/tags/Gitea" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Gitea</a> Projektverwaltung ist noch träumiger :D

✰ 𝔽𝕣𝕖𝕕 ✰Seems my snac2 instance is running behind <a href="https://social.freebsd.amsterdam?t=haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a>. \o/ CC: <a href="https://snac.it-notes.dragas.net/itnotes" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@itnotes@snac.it-notes.dragas.net</a>

Stefano MarinelliQuestion: Nginx or HAProxy as a reverse proxy? I’ve tested both. In some cases, I still need nginx, while in others, after a closer look, it’s not necessary. Performance, etc. Opinions from those who use/have used both?<a href="https://mastodon.bsd.cafe/tags/nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nginx</a> <a href="https://mastodon.bsd.cafe/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> <a href="https://mastodon.bsd.cafe/tags/reverseproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#reverseproxy</a> <a href="https://mastodon.bsd.cafe/tags/IT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#IT</a> <a href="https://mastodon.bsd.cafe/tags/SysAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SysAdmin</a>

@𝕗𝕕𝟘@𝕓𝕤𝕕.𝕟𝕖𝕥𝕨𝕠𝕣𝕜<a href="https://mastodon.bsd.cafe/@stefano" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@stefano</a> <a href="https://snac.it-notes.dragas.net/itnotes" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@itnotes</a> connection to <a href="https://exquisite.social/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> works fine, including TLS offloading. connection from <a href="https://exquisite.social/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> to <a href="https://exquisite.social/tags/snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> also works fine. I guess I still need to convert the <a href="https://exquisite.social/tags/apache" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#apache</a> or <a href="https://exquisite.social/tags/nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nginx</a> proxying to work properly….

@𝕗𝕕𝟘@𝕓𝕤𝕕.𝕟𝕖𝕥𝕨𝕠𝕣𝕜trying to setup <a href="https://exquisite.social/tags/snac" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#snac</a> behind <a href="https://exquisite.social/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> if all works well, will connect to another instance <a href="https://snac.it-notes.dragas.net/itnotes" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@itnotes</a>

ScriptFanix ❤️ ⏚ ⸫The above applies if the client reports "NS_PARTIAL_TRANSFER" and the stream state at disconnection reported by <a href="https://maly.io/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> is "cD"Stream state at disconnection: <a href="http://docs.haproxy.org/3.0/configuration.html#8.5" rel="nofollow noopener noreferrer" translate="no" target="_blank">http://docs.haproxy.org/3.0/configuration.html#8.5</a>

ScriptFanix ❤️ ⏚ ⸫random <a href="https://maly.io/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> tip:"My app has an endpoint that streams data for a long time, and my clients keep getting disconnected". They're probably disconnected because, when data is streaming, HAProxy doesn't hear back from the client. You need to increase "timeout client", but you probably don't want to do that site-wide. Set a timeout specific to that endpoint: http-request set-timeout client 2h if { path -m beg /index.php/apps/music/api/ }

HessenheldenIrgendwie bekomme ich (HA) <a href="https://mastodon.social/tags/Proxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Proxy</a> unter <a href="https://mastodon.social/tags/OPNsense" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OPNsense</a> nicht zum laufen und ich verstehe den Grund nicht. Einmal scheint es zu laufen und nach Änderung und Re-Änderung einer Option, mit löschen der LOG Datei, dann nicht mehr . Mich nervt das! <a href="https://mastodon.social/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a>

Stuart Longland (VK4MSL)This afternoon, I got close to what I wanted to achieve in terms of load-balancing between the two <a href="https://mastodon.longlandclan.id.au/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.longlandclan.id.au/tags/sabots" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sabots</a> I have running.I had originally planned to use <a href="https://mastodon.longlandclan.id.au/tags/OpenBSD" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenBSD</a>'s <a href="https://mastodon.longlandclan.id.au/tags/OpenHTTPD" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenHTTPD</a> or <a href="https://mastodon.longlandclan.id.au/tags/RelayD" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RelayD</a> to do the job, but <a href="https://mastodon.longlandclan.id.au/tags/HAProxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HAProxy</a> <a href="https://mastodon.longlandclan.id.au/tags/PROXY" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PROXY</a> protocol was the limiting factor… so I went <a href="https://mastodon.longlandclan.id.au/tags/nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nginx</a> instead.One thing I haven't worked out yet, is how to pass the client IP by PROXY protocol to a HTTP back-end. Seems I can do it for a generic TCP stream, but not HTTP.The alternative is to set X-Forwarded-For, and have the back-ends trust it, like they trust PROXY for the gateway's IPv4 address for <a href="https://mastodon.longlandclan.id.au/tags/sniproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sniproxy</a>.But… it works, you can hit <a href="https://sabot.vk4msl.com/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://sabot.vk4msl.com/</a> and you'll either get sabot01 (which uses nepenthes) or sabot02 (which uses iocaine). Since neither cares about the URI, I can bounce the client between them.This did get me thinking though, if enough of us did it, we could have a <a href="https://mastodon.longlandclan.id.au/tags/AISabotAsAService" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AISabotAsAService</a> for websites to redirect/link to when they think they're being scraped by an AI bot.We could provide a pool of servers that would provide the link maze. Front-end proxies would just bounce you between all the pool members, feeding your bot nonsense.

Markus LindenbergThese are the OSS projects I'm running that just upgraded without ever causing problems for me:<a href="https://chaos.social/tags/paperless" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#paperless</a> <a href="https://chaos.social/tags/prometheus" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#prometheus</a> <a href="https://chaos.social/tags/postgresql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#postgresql</a> <a href="https://chaos.social/tags/mosquitto" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mosquitto</a> <a href="https://chaos.social/tags/grafana" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#grafana</a> <a href="https://chaos.social/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> <a href="https://chaos.social/tags/navidrome" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#navidrome</a> <a href="https://chaos.social/tags/nodered" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nodered</a> <a href="https://chaos.social/tags/forgejo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#forgejo</a> <a href="https://chaos.social/tags/gitea" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gitea</a> <a href="https://chaos.social/tags/vaultwarden" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#vaultwarden</a> <a href="https://chaos.social/tags/keycloak" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#keycloak</a> <a href="https://chaos.social/tags/restic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#restic</a> <a href="https://chaos.social/tags/nginx" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nginx</a> <a href="https://chaos.social/tags/incus" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#incus</a> <a href="https://chaos.social/tags/zigbee2mqtt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#zigbee2mqtt</a> <a href="https://chaos.social/tags/semaphore" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#semaphore</a> <a href="https://chaos.social/tags/homeassistant" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#homeassistant</a>

Ain TohvriA moment when someone says "it has been made significantly easier" while posting an article with a lengthy scroll. <a href="https://www.haproxy.com/blog/haproxy-and-let-s-encrypt" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.haproxy.com/blog/haproxy-and-let-s-encrypt</a> <a href="https://mstdn.social/tags/haproxy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#haproxy</a> <a href="https://mstdn.social/tags/security" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#security</a> <a href="https://mstdn.social/tags/linux" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linux</a>

Recent searches

Search options

Administered by:

Server stats:

#haproxy