B

Bench IQ

The models make up both the product and the dataset. Bench IQ sells a description of how a named federal judge reasons, produced by large language models and AI agents from rulings never issued in writing. Without the models nothing remains to sell: no repository, workflow, document store or search over published opinions, and no dataset, because the dataset is itself extracted by machine from oral rulings and other unwritten indicators rather than a collection that existed beforehand.

The privacy policy names large language models as the means of analyzing rulings, and the vendor describes fine tuning commercial models on the dataset it built.

Nothing is published on accuracy or grounding for a product that makes claims about what a named judge thinks. The site has five pages, with the home page serving as the product page: three FAQ blocks, a social proof claim and a demo request. Checked those, plus the about, press, privacy policy and responsible disclosure pages,, and found no accuracy figure, test set, evaluation, error rate, failure modes or hallucination disclosure.

Verification matters especially here: the product's value is reaching the roughly ninety seven percent of rulings with no written opinion, so the source behind an insight is material a reader cannot easily check in a conventional research tool. Nothing says whether an insight links to the ruling it came from, whether a user can inspect that source, or what happens when the record is thin. Citator checks do not apply to a product that describes judicial reasoning rather than validating authority.

No oversight structure is published for a system whose output feeds live litigation strategy. Searched the home page, about page, press page, terms of service, privacy policy and responsible disclosure page: nothing describes what the models decide unattended, no review surface is documented, no confidence or abstention behavior is described, no statement tells a lawyer what weight an insight should carry, and no route exists to report or correct an insight that proves wrong.

The vendor is publicly careful about the framing, its chief executive saying the aim is not to predict the outcome of a case but to help lawyers shape it, which locates judgment with the lawyer. That distinction is real and is recorded here, but it was made in an interview rather than in product or policy material, and a framing is not a control.

Adoption counts and anonymous testimonials stand in for evidence. The vendor publishes two figures, both self-reported and neither naming anyone: four of the top five AmLaw firms are said to use the platform, and an earlier announcement put twelve of the hundred largest US firms as pilot customers actively using the product on live cases. Three testimonials appear on the home page attributed only by seniority and firm rank.

No customer is named anywhere, no case study exists, and no figure is published for what changed at any organization. One conflation to guard against, because the same names circulate in both roles: Cooley, Fenwick & West, Wilson Sonsini and several Kirkland & Ellis partners are investors in Bench IQ, not disclosed customers. Both bands have some purchase here, since an adoption count is closer to real deployment evidence than a logo strip, and the lower is taken because the count is unverifiable, unattributed and silent on outcome.

The published policy is a website and app privacy notice, not a customer data commitment. Effective 20 February 2025, it covers site visitors and app users and handles that well: personal data limited to name, job title, employer, work email and work phone, which the vendor notes is already public through firm websites, state regulators and PACER; no sale or rental of personal information; thirteen named subprocessors; storage and processing in the United States only; and a named security officer, the cofounder and chief technology officer.

The platform takes in judicial records, not client documents, so there is no client matter material to separate, no ethical wall to inherit and no privilege question about ingested content. What does apply is unanswered: a litigator researching a named judge on a named issue reveals the matter they are working on, and nothing says whether that query history is kept, analyzed, used to improve models or disclosed. No customer confidentiality commitment of any kind was found.

Nothing is published on the advice line, and no page exists that would usually carry it. The site has login, about us, careers and press in the navigation, and privacy policy, responsible disclosure, security and terms of service in the footer. There is no disclaimer or professional responsibility page, and none of the pages read says an insight is not legal advice, that no attorney client relationship arises, or that the lawyer remains responsible for the argument built on it.

No bar or ethics guidance is named, including ABA Formal Opinion 512, and no jurisdiction or practice limit is stated. The product exists to shape how counsel argues to a specific judge in a live matter. The terms of service could only be read in fragments through search, so a disclaimer could sit in the unread part.

No governance position is published for a system that models the reasoning of named federal judges. Searched the home, about, press, privacy policy, responsible disclosure and terms pages: no responsible AI statement, accountable owner for model behavior, testing regime before release, or evaluation of uneven output, and nothing on what it means to describe how identifiable federal judges think. The method is withheld, which the vendor attributes to pending patents, so a buyer can examine neither the governance nor the technique.

Bench IQ reconstructs judicial reasoning by large language model from material that was never published and cannot be independently checked, which makes the missing governance more significant.

Published policy covers most of the ground, and the subprocessor list is specific. The privacy notice effective 20 February 2025 names thirteen subprocessors, including Amazon Web Services, Heroku, Segment, Mixpanel, FullStory, Intercom, HubSpot, Notion, Slack, Sentry and Datadog, without any access request. It also states storage and processing in the United States only; retention for the life of the relationship plus a further period for the vendor's own operations and archiving; deletion by email request; data processing agreements and model clauses with vendors where feasible and appropriate; only essential cookies in the application; and a named security officer, the cofounder and chief technology officer.

A responsible disclosure program lists what is in scope, gives a reporting address, offers a discretionary reward, promises not to pursue researchers acting in good faith, and asks them to avoid privacy violations and disruption. The retention period after the relationship ends is not quantified, no access control model is described, and no breach notification practice was found.

What is published disclaims the risk and gives the buyer nothing. The terms provide the services as is, with all faults and as available, and disclaim all warranties, including merchantability, fitness for purpose and noninfringement. The customer's duty to indemnify Bench IQ and the limits on Bench IQ's liability survive termination, and Bench IQ may end the service without notice for any reason. No indemnity runs to the customer, no warranty covers any insight, and no insurance position appears.

No liability cap figure was found, so whether one exists is unknown. The text found reads as an evaluation agreement, framing permitted use as testing the services and giving feedback, which raises whether paying customers sign a separate commercial agreement. The terms could only be read in fragments through search, and a full reading could change the picture.

No integration into any practice system exists, and this is an absence rather than a gap in the reading. The site inventory was established directly from the navigation and footer: login, about us, careers, press, privacy policy, responsible disclosure, security and terms of service. There is no integrations page, no developer or API documentation, and no product page on which an integration might be described, because the home page is the product page.

Nothing names a document management system, matter management, e-billing, court filing, Word or Outlook, and no export or data feed is described. The product is reached through a browser at its own application and stands alone.

Residency is stated plainly. The privacy notice says personal information is stored and processed in the United States only, so a buyer knows where data sits and where it is handled, and the subprocessor list names Amazon Web Services and Heroku as hosts. Not published: a tenancy model, whether customer environments are separated, region options, an enterprise or private deployment option, or where inference runs as distinct from where records are stored. A five page site from a three year old company states its residency clearly.

A real third party trust center exists, hosted on Drata at a public address and linked from every page, so the vendor has set up an independent compliance portal and points to it prominently. The site itself names no standard, auditor, scope or coverage period on any page read. The portal could not be read that day, so nothing about its contents is assumed, and it may say more. On the pages read, all that is stated is that a trust center exists.

The vendor names the type of model but not whose. The privacy notice names large language models as the means of analyzing rulings, and the company has described fine tuning commercial large language models on its own dataset, so third party foundation models sit underneath. No provider, model or version is named, no inference location is given apart from US storage, and no commitment to notify customers of model or training data changes was found.

The same privacy notice names thirteen subprocessors for hosting, analytics, session recording, support, marketing and monitoring, and none is a model provider. A vendor that lists Sentry and Datadog by name but omits the systems that produce its core output has drawn a line somewhere, and nothing explains where or why.

No pricing information is published at any level, including the unit of charge, and no pricing page exists to carry it. The site inventory was established directly rather than assumed: the navigation is login, about us, careers and press, and the footer adds privacy policy, responsible disclosure, security and terms of service. There is no pricing page, no plan or tier names, no feature split, no per-seat, per-judge or per-report unit, no term length and no statement of what implementation adds.

The single call to action on the home page is a demo request. The only adjacent statement located is a 2024 interview in which the chief executive referred to flexible pricing models and said the product is designed for firms of all sizes, which names neither a figure nor a unit and does not appear on any vendor page.

The product page claims total coverage, and the real boundary appears only elsewhere. The home page describes covering all of a judge's rulings rather than the roughly three percent with written opinions, which reads as complete coverage, and names attorneys as the audience and large litigation firms as buyers. The real limits appear only in funding announcements: coverage is the US federal judiciary, starting with commercial bankruptcy, and state courts, where the vendor notes there are far more judges, are an expansion target along with other common law jurisdictions.

A buyer reading only the site would not learn that state court judges are missing. No practice area list, court by court coverage, list of judges or historical range is published.