The Prompt Desk

Justin Macorin, Bradley Arsenault

Embark on a captivating exploration of Large Language Models (LLMs), prompt engineering, and generative AI with hosts Bradley Arsenault and Justin Macorin. With 25 years of combined machine learning and product engineering experience, they are delving deep into the world of LLMs to uncover best practices and stay at the forefront of AI innovation. Join them in shaping the future of technology and software development through their discoveries in LLMs and generative AI. Podcast website: https://promptdesk.ai/podcast Hosted by Ausha. See ausha.co/privacy-policy for more information. read less
TecnologíaTecnología

Episodios

What we learned about LLM’s in a year
Hace 4 días
What we learned about LLM’s in a year
In this one year anniversary episode of the podcast, your show hosts look back on what they have learned and observed over the past year. They made the following observations:Reflection on a year of LLM development: The hosts discuss how the LLM ecosystem has rapidly evolved over the past year, moving from initial hype to a focus on practical applications with demonstrable ROI.Changes in prompt engineering: They note a shift from instruction-based prompting to example-based prompting, finding the latter more reliable.Impact on software development: LLMs have significantly increased productivity and are changing how software is architected and developed, making previously complex tasks much simpler and faster to implement.Shifting skill requirements: The hosts predict that soft skills will become more valuable for engineers, while specific programming language knowledge may become less crucial due to AI assistance.Evolving perspectives: Both hosts describe how their views on LLMs have changed, moving from initial skepticism to greater optimism about the technology's potential and impact.Future of the field: They emphasize the transformative nature of LLMs on the entire field of computer science and encourage newcomers to stick with it, predicting that those who do will become the experts shaping the future of technology. \---Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Hosted by Ausha. See ausha.co/privacy-policy for more information.
Validating Inputs with LLMs
25-09-2024
Validating Inputs with LLMs
In this thought-provoking episode, AI experts Bradley Arsenault and Justin Macorin delve into the cutting-edge world of input validation using large language models (LLMs). The hosts explore how this innovative approach is transforming traditional data validation methods in software applications.The conversation begins with a look at conventional input validation techniques, primarily relying on regular expressions (RegEx) for basic text field checks. Justin then introduces the concept of using LLMs to validate more complex inputs, such as job titles or descriptions, which go beyond simple character-level validation.Throughout the episode, the hosts discuss the numerous benefits of LLM-based validation, including improved downstream results in AI systems, reduction in nonsensical inputs, and the potential to decrease reliance on customer support teams. They also tackle the implementation challenges, such as increased computation costs and the risk of rejecting valid inputs in edge cases.Bradley and Justin provide insights into the technical aspects of implementing LLM validation, discussing where in the software architecture to place these checks and how to handle user feedback. They also explore future improvements to the system, such as incorporating probability thresholds and enhancing error messages with helpful examples.The episode concludes with a balanced view of the trade-offs involved in adopting this new approach. While acknowledging the potential for user resistance and increased complexity, the hosts argue that the long-term benefits of cleaner data and reduced errors make LLM-based validation a promising frontier in software development.This episode offers valuable insights for developers, data scientists, and product managers looking to enhance their applications' data quality and user experience through advanced AI techniques.---Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Hosted by Ausha. See ausha.co/privacy-policy for more information.
Should we let prompts write prompts?
10-07-2024
Should we let prompts write prompts?
In this thought-provoking episode, hosts Bradley and Justin explore the intriguing concept of using AI to write prompts for other AI systems. They delve into the paradoxical nature of this idea and discuss potential approaches to make it feasible.The hosts emphasize the importance of having a structured system and well-defined schemas when attempting to automate prompt creation. They argue that abstract prompt generation without context is impractical for real-world applications. Instead, they propose leveraging existing prompts and system knowledge to guide AI in creating new, relevant prompts.Bradley and Justin examine various methods for AI-assisted prompt writing, including fine-tuning models on existing prompts and using few-shot learning approaches. They stress the need for human oversight in the process, likening LLMs to three-year-olds that require clear examples and guidance.The conversation touches on the challenges of prompt iteration and version control, with Justin suggesting the potential for developing tools to manage prompt versions effectively. The hosts also briefly discuss optimization approaches and the complexities of chaining multiple prompts together.Throughout the episode, Bradley and Justin provide a pragmatic perspective on the future of AI-assisted prompt engineering, balancing enthusiasm for innovation with realistic expectations about current AI capabilities. Listeners will gain valuable insights into the nuanced world of prompt creation and the potential for AI to augment this process in meaningful ways.---Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.
[Bonus] LLMs making Web-Browsing Decisions
01-06-2024
[Bonus] LLMs making Web-Browsing Decisions
[Bonus] This is a bonus episode. We had too many unreleased episodes in our backlog, so we decided to give you an extra treat this week! Hope you enjoy it!Join the discussion on how AI agents can intelligently browse websites to retrieve specific information across links and pages. The hosts dive deep into techniques like embedding link text, URL paths, and accessibility attributes to compare against the desired information goal. They explore methods to filter and re-rank links through this embedding approach, accounting for factors like the total number of links per page and whether the target requires navigating across multiple sites.The conversation covers setting reasonable boundaries on recursive browsing, using a large language model for final relevance assessment, and the broader considerations of efficient agent design for web information retrieval tasks. With their combined 25+ years of AI engineering experience, the hosts provide insights into this emerging and complex challenge.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.
[Bonus] Non-Engineers and Prompts
25-05-2024
[Bonus] Non-Engineers and Prompts
[Bonus] This is a bonus episode. We had too many unreleased episodes in our backlog, so we decided to give you an extra treat this week! Hope you enjoy it!Dive into the world of prompt engineering for large language models like GPT. This episode explores the important role that non-technical subject matter experts play in developing effective AI prompts and systems. The hosts discuss how domain experts across industries like food, real estate, and medicine are uniquely qualified to label training data, provide contextual knowledge, and design prompts that capture the right tone and style for their field. The hosts argue that while engineering expertise is needed for certain technical aspects, most prompts should be designed collaboratively with non-technical experts leading the way. With over 25 years of combined AI and product experience, the hosts share insights on bridging the gap between technical and non-technical teams for successful prompt engineering.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.