Tap Forms for RAG

Tagged: 

Viewing 6 reply threads
  • Author
    Posts
  • May 28, 2024 at 9:27 AM #50759

    James Anderson
    Participant

    I see a lot of potential for using Tap Forms for RAG (Retrieval Augmented Generation) for AI tools. Is there any chance this is being explored? Is there anything that the users can do to help with this if it is being explored? Are you waiting to see what Apple introduces at WWDC in the way of AI developer tools and frameworks for GenAI?

    May 28, 2024 at 9:22 PM #50760

    Brendan
    Keymaster

    Hi James,

    I’m not sure what Retrieval Augmented Generation is. But yes, I’m waiting to see what Apple provides developers at WWDC. Hopefully something that doesn’t cost us to integrate into our apps.

    I did write a simple ChatGPT script in Tap Forms to call out to their service though. It worked pretty well. Type in your question or statement into a field, then it goes out and gets the response and populates the Script field with the results. Great to keep int he database and be able to do queries on it.

    But I can see other uses for AI such as to create forms for you or analyze your data.

    Thanks,

    Brendan

    May 29, 2024 at 3:11 AM #50761

    Chris Ju
    Participant

    I suppose many LLMs should be possible (e.g. Meta LLaMa) because many of them can be called with http/url commands using JavaScript …

    May 29, 2024 at 6:31 AM #50763

    James Anderson
    Participant

    Good morning, Brendan. RAG is a technique for a Generative AI (GenAI or just AI these days), to access a specific external data source for specific knowledge. For example, a chatbot on a website for customer service or sales support would be best if it had a live, up-to-date, source of information for policies, procedures, products, and services. One or more databases would be linked to the chatbot so that it has what it needs to give good information and not hallucinate or just be ignorant of possible answers.

    So, to keep it simple, imagine a Tap Form database of internal contact information for a company. It would have your standard phone numbers, email addresses, physical addresses, etc. and maybe a bit on the actual responsibilities and authority of each person. If you wanted to find the right person in your company to deal with an issue, you could explain the issue to your internal chatbot and it would be able to find the right person or people for you.

    And this goes beyond keyword searches. GenAI is able to infer intent and additional meaning and context from a conversation. Hopefully, Apple will provide you with the Core[whatever they call it] framework so you can integrate GenAI directly into your app for directly helping users with your app.

    But the first thing I thought of as a useful tool would be access to a database for structured RAG that is also local and live. If you ever want to discuss the possibilities and potential methods of executing and of this let me know.

    As a side note, I’m really hoping that Apple will integrate GenAI into Xcode for enable faster, better, app development. There are so many possibilities with this in Xcode.

    BTW…you may want to consider beefing up your AppleScript support and adding Shortcuts triggers/actions.

    A use case for this (and it would replace my current use of AirTable and Zapier Tables) is helping a Mac magazine with the press release handling. This is where they have a bunch of RSS feeds from manufacturers that cover the company news (press releases) that each sends out. The workflow pulls the press release (article) information from the RSS feed and places all of the information into a database (AirTable for this one). Then the workflow goes through a variety of tasks that use Generative AI to perform. Finally, a magazine editor reviews the processed articles for publishing and makes the decisions on things like titles, pull quotes, summaries, adds opinions, images, etc. All of this and the status of the article is stored in the database. Finally, the workflow pulls the final article information from the database and publishes it to the various platforms (magazine website, X.com, LinkedIn, etc.).

    Sorry for the long post, but I see a huge opportunity here for a local Mac database tool. Filemaker has blown it for smaller developers with local use cases because of their cost. I think that aggressive AI integration and positioning as a local Mac RAG resource could be a nice first mover for you.

    Have a great day.

    May 29, 2024 at 6:48 AM #50764

    James Anderson
    Participant

    I think you are thinking of calling an LLM from within Tap Forms. That is another use case. I’m suggesting that Brendan look into making sure his tool is set up for the various GenAI tools are able to access Tap Forms database easily. This could be accomplished by providing an API into Tap Forms, AppleScript, or Shortcuts. Each method has pros/cons, but all should probably be pursued.

    However, I think that Brendan, like everyone else in the Apple ecosystem, is waiting to see what Apple does with AI. Hopefully, the annual release schedule with long times before actual release will not cause Apple a fall similar to Nokia/Blackberry. And annual release schedule in a world where the state of the technology and tools/products is advancing daily seems like a very bad idea.

    June 2, 2024 at 9:48 PM #50767

    Brendan
    Keymaster

    Hi James,

    That’s an interesting use case for AI. We’ll see what Apple has up its sleeves for integrating AI into their OS. Right now the script I wrote simply establishes a REST connection to OpenAI and submits a message and gets a response. I also wrote another script I can use for translating forms to different languages. It’s still a work-in-progress though.

    I agree better AppleScript and Shortcuts support is needed. You can also call into Tap Forms with a URL that can execute a script. You can even pass Tap Forms parameters that way.

    See the section on this page called “Calling a Script from a URL”:

    https://www.tapforms.com/help-mac/5.3/en/topic/javascript-api

    Thanks,

    Brendan

    June 10, 2024 at 6:14 PM #50783

    James Anderson
    Participant

    Brenan, what are your thoughts now? With App Intents and Apple Intelligence, I think you will have your plate full of things that you can do and add to Tap Forms and you may have a larger audience that will have a reason to store more things in a database since that information can be made available to Apple Intelligence for Siri to use in other apps easily.

    For example, a user could ask Siri to pull sales for the past month made to people in the state of Maine over the past month and put them in a table in a new email to Bob, the CEO. Siri will do all of that for them without any further user interaction.

    And, if I’m seeing it correctly, using App Intents you might be able to chat with Siri to get a list of common attributes to track in a home inventory database and then ask Siri to create that table in Tap Forms for you–with no further interaction from the user. Then you could ask Siri to use a Numbers spreadsheet you’ve been tracking your home inventory inside of and import that to the new Tap Forms database…all with voice.

    What are your thoughts?

    June 10, 2024 at 11:03 PM #50784

    Brendan
    Keymaster

    Well, the one about asking Siri to create a table for you in Tap Forms is something I’ve already been thinking about for the new template library I’m building. With a prompt of something like “Can’t find a form you’re looking for? Describe it here and we’ll make it for you:”. Or something like that.

    I’ll have to play around with it for a while to get an idea of what sorts of things I can do with it from a development perspective.

    Lots of fun things to play with for sure from WWDC today.

    June 11, 2024 at 5:30 AM #50786

    James Anderson
    Participant

    Excellent! I’ve been using a workaround for that. I ask ChatGPT for a suggestion of items to track in a database for a particular need. It gives me a list of fields to track. Then I ask it to give me a CSV file with those fields and some sample data in say 10 records. I download the file and import the CSV into a new Tap Form form and I have a database that just needs me to change up the fields types and other details.

    But don’t forget the RAG. Apple Intelligence is personal intelligence. Making your database fully accessible to Siri will enable the GenAI to know a lot more personal information about the user’s context. Apple Notes and loose documents laying around the file system will provide a lot of unstructured context. But Tap Forms could provide a pace for more structured context.

    June 11, 2024 at 11:55 AM #50787

    James Anderson
    Participant

    Siri will have access to data if the application opts in.

     

    Siri Access to Apps Data

Viewing 6 reply threads

You must be logged in to reply to this topic.