{"id":20407,"date":"2026-07-23T20:09:54","date_gmt":"2026-07-23T20:09:54","guid":{"rendered":"https:\/\/www.comet.com\/site\/?p=20407"},"modified":"2026-07-23T20:09:55","modified_gmt":"2026-07-23T20:09:55","slug":"digibee-opik-user-story","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/","title":{"rendered":"One Prompt, 24 Versions: How Digibee Builds Prompts with Opik to Power Their AI-Native Integration Platform"},"content":{"rendered":"\n

Digibee was founded 9 years ago to solve a key problem in enterprise tech stacks: tools didn\u2019t integrate neatly with one another, and humans were left to manage the connections between systems and the infrastructure to support those connections. Digibee built a visual canvas that abstracted away the infrastructure piece and let users focus on the logic connecting systems.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

As AI agents become part of the technology stack, Digibee has evolved with a new approach built around AI<\/a>. This redesign challenged us to figure out how to make LLMs behave like savvy integration engineers.    <\/p>\n\n\n\n

Opik played a key role in that work.<\/p>\n\n\n\n

The Project: An AI-Native Interface<\/h2>\n\n\n\n

Integration work typically happens in two phases. In the first, teams compile their requirements\u2014often across whiteboards, documents, or spreadsheets. This can take weeks, depending on the complexity of the integration. In the second phase, an integration specialist builds the required workflows according to the specification.<\/p>\n\n\n\n

In our new version of Digibee, integration engineers direct Digibee Digital Workers, agents equipped with deep integration expertise<\/a>. <\/p>\n\n\n\n

Users start by explaining what kind of integration they want to build. The Digital Worker asks strategic questions as it builds out a detailed specification. The user makes any needed comments or edits, live, in the interactive document. We call this \u201cintent-to-spec.\u201d Together, users and digital workers complete a specification in as little as a couple of hours.<\/p>\n\n\n\n

Next, the Digital Worker generates production-grade workflows according to the specification, which only takes a few minutes. The user checks the results in Digibee\u2019s visual canvas<\/a>, making small adjustments where necessary. Our goal is for the first draft to be 90+% correct. In a recent experiment, it created a complicated EDI pipeline that was 100% deployment-ready.<\/p>\n\n\n\n

Creating this interface required our team to build new tools to allow the AI to interact with our platform. It also required that we write a library of prompts, and manage those prompts in a prompt-management platform.<\/p>\n\n\n\n

Why We Chose Opik<\/h2>\n\n\n\n

Building for AI meant crafting, experimenting with, and iterating on prompts the same way that we handle code. In previous roles, I preferred to build core tools rather than buy them, but I knew we needed something off the shelf for this project. Creating our own tools to handle versioning, experiment comparison, and LLM instrumentation would take four to six months. We didn\u2019t have that time. We needed to ship a product<\/p>\n\n\n\n

We chose Opik close to a year ago, during the project\u2019s alpha phase. Our three-person AI team (which has since grown), compared Opik against two other platforms. We picked Opik because we saw excellent value and quality in the feature set for our team\u2019s size and day-to-day needs. <\/p>\n\n\n\n

In particular, we found Opik easy to integrate. We can use the SDK or do API calls where appropriate. We also found Opik\u2019s documentation complete and easy to understand.<\/p>\n\n\n\n

Managing & Versioning Dozens of Prompts<\/h2>\n\n\n\n

The current version of the Digibee Digital Worker uses around 20 prompts and prompt templates, but my team has written nearly 100 for distinct tasks. Prompts commonly go through 10-20 revisions before they stabilize\u2014or before we split, combine, or deprecate them. One prompt went through 24 versions between August and September of 2025 before deprecation.<\/p>\n\n\n\n

For each prompt, we start by writing a draft that\u2019s as complete as possible. Then, we refine it through small experiments. Each new version covers one or more gaps identified through Opik. At the same time, we try to ensure that we don\u2019t over-fit to the corner cases.<\/p>\n\n\n\n

Opik’s prompt library<\/a> lets the team push those revisions without a full deployment. We just update the prompt page. This saves us from needing a full release cycle from every change. This is one of the main advantages of using a prompt management platform instead of versioning prompts exclusively alongside the codebase (e.g., in Git).<\/p>\n\n\n\n

Comparing Ten Sessions Against the Same Pipeline<\/h2>\n\n\n\n

To measure the impact of changes to prompts or the surrounding ecosystem, we run batches of 10 simulated sessions against a target pipeline type and export the results to Opik. We compare metrics across runs: plan drift, cost, step coverage, and several custom measures built around how closely the generated pipeline matches what a human would build.<\/p>\n\n\n\n

In May, we ran a batch of experiments on the main workflow generation prompt. Opik clearly showed the value of our choices; the most complicated version of our prompt not only achieved a higher similarity score to our target output, it also completed its work faster and used fewer tokens.<\/p>\n\n\n\n

We supplement work in Opik by comparing generated flows to \u201cgolden flows\u201d created by a member of Digibee’s professional services team. This catches gaps that don’t show up in the automated test set.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Results with Opik <\/h2>\n\n\n\n
\n

Months of engineering time redirected.<\/strong> By buying Opik, I estimate that we saved four to six months of build time vs building our own tooling. That time went into the intent-to-spec process and pipeline generation instead.<\/p>\n<\/blockquote>\n\n\n\n

\n

No-deploy prompt updates.<\/strong> Prompt changes ship by editing the prompt directly in Opik, without a backend release.<\/p>\n<\/blockquote>\n\n\n\n

\n

A workable read on drift.<\/strong> Batch experiment comparisons in Opik, combined with manual review from professional services, give the team a way to catch regressions before a prompt change reaches production<\/p>\n<\/blockquote>\n\n\n\n

What\u2019s Next?<\/h2>\n\n\n\n

We like to frame this project\u2019s ambition against Digibee’s history: the original platform cut the time to build system integrations by 10-20x. The AI-native rewrite is aimed at a similar jump. <\/p>\n\n\n\n

Digibee’s AI team has grown since the original three-person build-or-buy decision. With a working early access version in production, we expect to use the next three to six months investing in improvements across the entire systems integration lifecycle. Opik has settled into the role of system of record for that work: where prompts live, where their version history lives, and where the team checks whether a change made things better or worse before it ships.<\/p>\n","protected":false},"excerpt":{"rendered":"

Digibee was founded 9 years ago to solve a key problem in enterprise tech stacks: tools didn\u2019t integrate neatly with one another, and humans were left to manage the connections between systems and the infrastructure to support those connections. Digibee built a visual canvas that abstracted away the infrastructure piece and let users focus on […]<\/p>\n","protected":false},"author":132,"featured_media":20410,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[8,10,65,363,9],"tags":[],"coauthors":[370],"class_list":["post-20407","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-comet-community-hub","category-industry","category-llmops","category-opik-user-stories","category-product"],"yoast_head":"\nHow Digibee Builds & Versions Prompts with Opik<\/title>\n<meta name=\"description\" content=\"Learn how Digibee uses Opik to save dev time, version and update prompts without redeploying, and monitor drift in their AI-native integration platform.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"One Prompt, 24 Versions: How Digibee Builds Prompts with Opik to Power Their AI-Native Integration Platform\" \/>\n<meta property=\"og:description\" content=\"Learn how Digibee uses Opik to save dev time, version and update prompts without redeploying, and monitor drift in their AI-native integration platform.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2026-07-23T20:09:54+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-07-23T20:09:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"903\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Luciano Chaves\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Luciano Chaves\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How Digibee Builds & Versions Prompts with Opik","description":"Learn how Digibee uses Opik to save dev time, version and update prompts without redeploying, and monitor drift in their AI-native integration platform.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/","og_locale":"en_US","og_type":"article","og_title":"One Prompt, 24 Versions: How Digibee Builds Prompts with Opik to Power Their AI-Native Integration Platform","og_description":"Learn how Digibee uses Opik to save dev time, version and update prompts without redeploying, and monitor drift in their AI-native integration platform.","og_url":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2026-07-23T20:09:54+00:00","article_modified_time":"2026-07-23T20:09:55+00:00","og_image":[{"width":2560,"height":903,"url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","type":"image\/jpeg"}],"author":"Luciano Chaves","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Luciano Chaves","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/"},"author":{"name":"Mike Ranellone","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b0df8d0db9a521af425e33f561b39c6a"},"headline":"One Prompt, 24 Versions: How Digibee Builds Prompts with Opik to Power Their AI-Native Integration Platform","datePublished":"2026-07-23T20:09:54+00:00","dateModified":"2026-07-23T20:09:55+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/"},"wordCount":1014,"commentCount":0,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","articleSection":["Comet Community Hub","Industry","LLMOps","Opik User Stories","Product"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/","url":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/","name":"How Digibee Builds & Versions Prompts with Opik","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#primaryimage"},"thumbnailUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","datePublished":"2026-07-23T20:09:54+00:00","dateModified":"2026-07-23T20:09:55+00:00","description":"Learn how Digibee uses Opik to save dev time, version and update prompts without redeploying, and monitor drift in their AI-native integration platform.","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#primaryimage","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","width":2560,"height":903},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/digibee-opik-user-story\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"One Prompt, 24 Versions: How Digibee Builds Prompts with Opik to Power Their AI-Native Integration Platform"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b0df8d0db9a521af425e33f561b39c6a","name":"Mike Ranellone","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/47e0209bd037ec57787bae2b580d796f","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/06\/cropped-mike-ranellone-96x96.jpg","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/06\/cropped-mike-ranellone-96x96.jpg","caption":"Mike Ranellone"},"sameAs":["https:\/\/www.comet.com\/"],"url":"https:\/\/www.comet.com\/site\/blog\/author\/mikercomet-com\/"}]}},"jetpack_featured_media_url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2026\/07\/OpikDigbee-2-scaled.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/20407","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/132"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=20407"}],"version-history":[{"count":1,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/20407\/revisions"}],"predecessor-version":[{"id":20412,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/20407\/revisions\/20412"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media\/20410"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=20407"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=20407"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=20407"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=20407"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}