LLMs as general reasoners

In ML it’s common to measure generalization performance as the delta between the training, validation and test dataset. Training data is what your model actively optimizes against using some optimization procedure (e.g. SGD or conjugate gradient or quadratic programming). The validation data is used to get an unbiased estimate of the performance of the model on unseen data. Since the process of selection (hyper parameter selection, stopping criteria) invariably overfits the model to the validation data at the very end we get an estimate of model performance through the test dataset that should not be used for the process of training a model....

August 21, 2023 · 4 min · 702 words · Rick Lamers

Streaming a USB camera from a Raspberry Pi (4B)

A neat use case for Raspberry Pi I was looking for a way to monitor my puppy’s dog crate and I figured a good approach would be to use my PS3 eye USB camera with my Raspberry Pi 4 to stream audio and video to my phone. Buying a dedicated monitoring handheld felt like a waste of money, since I already had the hardware to do it, in theory. Of course, in practice you run into issues and in this article I’ll describe the issues I ran into and how I solved them....

August 20, 2023 · 5 min · 1024 words · Rick Lamers

Writing my own ChatGPT Code Interpreter

tl;dr: github.com/ricklamers/gpt-code-ui and to run it pip install gpt-code-ui && gptcode Alright, I’ll cut right to the chase. I’ve built GPT-Code UI because OpenAI couldn’t be bothered to give me access to their new fancy ChatGPT Code Interpreter. And most likely, you don’t have access either. What is ChatGPT Code Interpreter? Well, it’s basically a REPL (read–eval–print loop) that’s integrated with the coding abilities of ChatGPT. You can do really neat things with it like giving it a file (e....

May 17, 2023 · 9 min · 1736 words · Rick Lamers

Writing resources

CommonMark live testing tool CommonMark Dingus is an interactive playground for testing Markdown formatting in real-time. It’s particularly useful for debugging complex Markdown syntax and seeing how it renders instantly. The tool shows both the rendered output and the HTML that gets generated, making it invaluable for precise Markdown formatting. Hugo docs The Hugo documentation is the comprehensive official guide for the Hugo static site generator. It covers everything from basic setup to advanced features like templates, shortcodes, and content management....

May 15, 2023 · 1 min · 136 words · Rick Lamers