> to run a million records of something, especially public data, through an LLM to extract the data you need
replyMaybe this make sense, but anyway I have to pay a lot of attention at the output I get. Eg: who guarantees there is no prompt/sql injection? Especially if I have to load the output in some internal system.
Bulk data processing typically has structured JSON output.
replyI mean someone could try to sneak prompt injection into a text field, but the people buying black market resale tokens from third parties aren’t thinking about anything other than getting cheap output.