Discussion about this post

User's avatar
CogDog's avatar

Interesting that you can guide the machine this way. I wonder though about

"Prioritize scholarly accuracy, verified information, and conceptual nuance. Ground analytic or theoretical answers in peer-reviewed research and include APA-formatted citations with real sources only when evidence is referenced."

Because no matter how well framed the response is, as far as I know GenAI still lacks an ability to fact check and verify information, it can only write like it is. Can it look up and locate information? Can it provide the web URLs for things it returns? Does it still write well formatted citations for stuff that does not exist? Or am I wrong?

I also noted in a very small task I had asked NotebookLLM to anonymize a zoom chat by replacing participant names with asterisks using:

""Make a copy of this transcript where participants names are made private by replacing all letters in a name with an asterisk * except for hosts [name removed], Alan Levine, [name removed], and [name removed]"

It did it perfectly the first time, but I messed up the output trying a search and replace for another part of the file. So I went back, and redid the hole process. This time for some reason, it returned the anonymized names with asterisks but our the names right after in parentheses, calling for a prompt wrist slap do over.

Same data. Same prompt. Different results. And this is a rather trivially simple task.

Expand full comment
Rebecca Guglielmo's avatar

Thank you for sharing, Lance! In older models I found Chat and Claude struggled to hold on to instructions within a chat thread and gave up relying on them. This was a timely reminder to try again. I’m looking forward to seeing how custom GPTs impact the quality of outputs.

Expand full comment
3 more comments...

No posts