howrar

https://bsky.app/profile/natolambert.bsky.social/post/3lh5jih226k2k

Anyone interested in learning about RLHF? This text isn't complete yet, but looks to be a pretty useful resource as is already.

Apparently we can register as a liberal to vote in the upcoming leadership race. What does it mean if I register? What do I gain (besides the aforementioned voting) and does it place any kind of restrictions on me (e.g. am I prevented from doing the same with a different party)?

An overview of RL published just a few days ago. 144 pages of goodies covering everything from basic RL theory to modern deep RL algorithms and various related niches.

This manuscript gives a big-picture, up-to-date overview of the field of (deep) reinforcement learning and sequential decision making, covering value-based RL, policy-gradient methods, model-based methods, and various other topics (including a very brief discussion of RL+LLMs).

If there's insufficient space around it, then it'll never spawn anything. This can be useful if you want to keep a specific spawner around for capture later but don't want too spend resources on killing the constant stream of biters.

I'm looking to get some smart light switches/dimmers (zigbee or matter if that's relevant), and one of the requirements for me is that if the switches aren't connected to the network, they would behave like regular dumb switches/dimmers. No one ever advertises anything except the "ideal" behaviour when it's connected with a hub and their proprietary app and everything, so I haven't been able to find any information on this.

So my question: is this the default behaviour for most switches? Are there any that don't do this? What should I look out for given this requirement?

Edit: Thanks for the responses. Considering that no one has experienced switches that didn't behave this way nor heard of any, I'm proceeding with the assumption that any switch should be fine. I got myself some TP Link Kasa KS220 dimmers and it works pretty well. Installation was tough due to its size. Took me about an hour of wrangling the wires so that it would fit in the box. Dimming also isn't as smooth as I'd like, but it works. I haven't had a chance to set it up with Home Assistant yet since the OS keeps breaking every time I run an update and I haven't had time to fix it after the last one. Hopefully it integrates smoothly when I do get to it.

This is a video about Jorn Trommelen's recent paper: https://pubmed.ncbi.nlm.nih.gov/38118410/

The gist of it is that they compared 25g protein meals vs 100g protein meals, and while you do use less of it for muscle protein synthesis at that quantity, it's a very minor difference. So the old adage still holds: Protein quantity is much more important than timing.

While we're at it, I'd also like to share an older but very comprehensive overview of protein intake by the same author: https://www.strongerbyscience.com/athlete-protein-intake/

Ten years ago, Dzmitry Bahdanau from Yoshua Bengio's group recognized a flaw in RNNs and the information bottleneck of a fixed length hidden state. They put out a paper introducing attention to rectify this issue. Not long after that, a group of researchers at Google found that you can just get rid of the RNN altogether and you still get great results with improved training performance, giving us the transformer architecture in their Attention Is All You Need paper. But transformers are expensive at inference time and scale poorly with increasing context length, unlike RNNs. Clearly, the solution is to just use RNNs. Two days ago, we got Were RNNs All We Needed?

Recordings for the RLC keynote talks have been released.

Keynote speakers:

• David Silver
• Doina Precup (Not recorded)
• Peter Stone
• Finale Doshi-Velez
• Sergey Levine
• Emma Brunskill
• Andrew Barto

OpenAI just put out a blog post about a new model trained via RL (I'm assuming this isn't the usual RLHF) to perform chain of thought reasoning before giving the user its answer. As usual, there's very little detail about how this is accomplished so it's hard for me to get excited about it, but the rest of you might find this interesting.