Sunday, December 24, 2023

Merry Christimas! ... Also my thoughts about GPT

Merry Christmas and may you all have a Happy New Year!!!

As I'm starting my end-of-year vacation, I wanted to address my readers about how I'm planning to continue my blog in the future.  As much as I enjoy writing for you all, I realized that I prefer being spontaneous with my blog posts since I live a fairly structured life outside of blogging.  Instead of racking my brain with a new topic to write about every month, and getting stressed because I couldn't stick to my schedule, I'm going to continue taking a loose approach to writing.  

If you're not already aware, I work as a data scientist building and researching machine learning models applicable for improving existing services or developing new solutions.  I'm currently working on GPT models, including the latest GPT4, so I figured I could write how I feel about GPT for today and the foreseeable future.

In terms of asking GPT to perform a certain task in general, I believe that GPT is a very useful tool to help structure your writing, provide rough translations, or produce reasonable summaries, or really any task involving the written language.  However, I do believe that objectively testing how accurate the information is and how well GPT adheres to specific additional restrictions remains a difficult issue that will be a central research topic.  I enjoy the flexibility of being able to utilise prompting methods more flexibly using the programmatic interface rather than ChatGPT or Playground.  Due to the boom of ChatGPT, as well as other AI tools, I figured that you be interested in reading about such tools from someone that is currently paid to research and refine them 👀 

Hopefully you will look forward to future posts... when they come out XD  
How do you feel about ChatGPT?  Do you find it to be a useful and innovative tool to solve your problems or improve your work?  Let me know in the comments below!

Again, Merry Christmas and have a lovely New Year! 


LLM Part 2: Encoding

Welcome to Part 2 of building your own large language model! Part 1 was about breaking down your input text into smaller subwords. (tokeniza...