Heroku Is Dead

June 29, 2023
Heroku, pgvector, AI, PostgreSQL, Render, AWS, RDS

UPDATE: In response to the clamor from its users, Heroku has made an announcement on July 28th 2023: We are prioritizing this work and are now actively working on it! I will update with more information once we are working through readiness checks. Aiming to GA within the next quarter. @bf4 You are right that this has been on our radar for a while. To be transparent, we are heavily investing (and prioritizing) in our Postgres infrastructure revamp work, which can provide better performance, more flexibility/elasticity, as well as solid foundation to build up more features, including more extensions (incl. ...

What is a Transformer?

June 28, 2023
OpenAI, Machine Learning, Transformers, AI, Deep Learning

The paper “Attention Is All You Need” kept coming up in my circles to read and I finally found time to look at it. It talks about a revolutionary architecture that has been a game-changer in the field, particularly when it comes to natural language processing. For those in the know, the concept is called a Transformer. It’s old news at this point, but for the uninitiated, what exactly is a Transformer, and how does it work? ...

OpenAI Crystal Library

June 21, 2023
OpenAI, Crystal Lang, Programming, Autonomous Systems, API, guppi, Code Assistant, Library, AI

Hello everyone! I’ve been developing a new library for OpenAI in Crystal Lang. My fascination with autonomous systems led me to create a semi-autonomous assistant to aid my coding process. There was an existing OpenAI library in Crystal, but it didn’t quite meet my needs and lacked some key features. The most significant addition I’ve made is streaming, which is necessary for streaming code output to the user that guppi is writing. ...