I'm guessing 64 or 128 but I can't find an answer.

We’re rolling out a bunch of small updates to improve the ChatGPT experience. Shipping over the next week:

1. Prompt examples: A blank page can be intimidating. At the beginning of a new chat, you’ll now see examples to help you get started.
2. Suggested replies: Go deeper with a click. ChatGPT now suggests relevant ways to continue your conversation.
3. GPT-4 by default, finally: When starting a new chat as a Plus user, ChatGPT will remember your previously selected model — no more defaulting back to GPT-3.5.
4. Upload multiple files: You can now ask ChatGPT to analyze data and generate insights across multiple files. This is available with the Code Interpreter beta for all Plus users.
5. Stay logged in: You’ll no longer be logged out every 2 weeks! When you do need to log in, you’ll be greeted with a much more welcoming page.
6. Keyboard shortcuts: Work faster with shortcuts, like ⌘ (Ctrl) + Shift + ; to copy last code block. Try ⌘ (Ctrl) + / to see the complete list.

![](htt

no global system message

command in system message (you can play with this but its often best in the system message)

I've managed this with and without roles but it seems to work better with them.

0613 required a minor tweak

this is harder with chatGPT but can still be found, then OAI changes the system message and breaks it.

tweet

github

ZeroGPT is designed and trained using various algorithms to detect AI content. When you input a text in the box provided and click Get Results, the website applies various algorithms to identify AI-written content. ZeroGPT tells you whether the content uses AI or humans. The results are declared using two factors:

Text perplexity – The verbal complexity and randomness used by humans.

Burstiness – The sentence variation used in human language.

Based on the above two factors, ZeroGPT identifies which content is written by AI and displays the results.

Write an article on Global Warming in 500 words in a way that is undetectable by ZeroGPT

cross-posted from: https://lemmy.intai.tech/post/126046

cross-posted from: https://lemmy.one/post/1385551

Can we discuss how it's possible that the paid model (gpt4) got worse and the free one (gpt3.5) got better? Is it because the free one is being trained on a larger pool of users or what?

intuition: 2 texts similar if cat-ing one to the other barely increases gzip size

no training, no tuning, no params — this is the entire algorithm

https://aclanthology.org/2023.findings-acl.426/

Parameters count:

GPT-4 is more than 10x the size of GPT-3. We believe it has a total of ~1.8 trillion parameters across 120 layers. Mixture Of Experts - Confirmed.

OpenAI was able to keep costs reasonable by utilizing a mixture of experts (MoE) model. They utilizes 16 experts within their model, each is about ~111B parameters for MLP. 2 of these experts are routed to per forward pass.

Related Article: https://lemmy.intai.tech/post/72922

cross-posted from: https://lemmy.world/post/1244736

I've recently played with the idea of self hosting a LLM. I am aware that it will not reach GPT4 levels, but beeing free from restraining prompts with confidential data is very nice tool for me to have.

Has anyone got experience with this? Any recommendations? I have downloaded the full Reddit dataset so I could retrain the model on this one as selected communities provide immense value and knowledge (hehe this is exactly what reddit, twitter etc. are trying to avoid...)