this post was submitted on 24 Jul 2023
43 points (95.7% liked)

Lemmy.ca's Main Community

3032 readers
5 users here now


Welcome to the lemmy.ca/c/main community!

All new users on lemmy.ca are automatically subscribed to this community, so this is the place to read announcements, make suggestions, and chat about the goings-on of lemmy.ca.

For support requests specific to lemmy.ca, you can use [email protected].


founded 4 years ago
MODERATORS
43
Downtime (self.main)
submitted 2 years ago* (last edited 2 years ago) by Shadow to c/main
 

Sorry about that! Service ran out of memory for some reason and I took some time to investigate.

Edit: Going to take a second hit, rebooting again to roll back a kernel upgrade that was applied yesterday.

Edit2: It's fixed properly now.

top 6 comments
sorted by: hot top controversial new old
[–] Shadow 13 points 2 years ago* (last edited 2 years ago) (2 children)

We seem to be missing about 20gb of our system memory. https://pastebin.com/teprs4qA

Let me know if you have any ideas. No it's not cache, and there's no ZFS on the system =)

[–] Shadow 16 points 2 years ago* (last edited 2 years ago)

Never mind, figured it out. I turned on hugepages without setting it up properly.

Look at all this beautiful free ram.

lemmy01 ~ # free -m
               total        used        free      shared  buff/cache   available
Mem:           31983        1491       20070         558       10421       29485
Swap:           1023           3        1020
[–] anonymoose 4 points 2 years ago

No ideas here, but memory leaks are always fun to diagnose 🙃

[–] Grant_M 3 points 2 years ago

Thank you for the update!

[–] Zoidsberg 3 points 2 years ago (1 children)

Is there somewhere we can look for updates (maybe a Mastodon account) when something like this happens?

Thanks for getting it back online so quickly!

[–] Shadow 4 points 2 years ago

https://status.lemmy.ca/

The section at the top auto updates.