Knowledge assistants

Use Confluence and Notion as controlled RAG sources

Reading time
8 minutes
Published
Written by
modernagents editorial teammodernagents is an AI automation agency for SMEs.
Illustration: two binders held by a locked strap, next to a page being synchronised

Confluence and Notion can supply a RAG knowledge assistant when ingestion preserves content, provenance, freshness and access boundaries. A connection that reads a few pages successfully is not yet a complete integration. Nested content, attachments, permissions and later deletion need explicit checks.

Key takeaways

  • Confluence: retain stable page identity, version, title, space and original link alongside the text.
  • Notion: a page identifier and title do not prove complete content ingestion; the importer must detect additional result pages and nested children.
  • Both platforms: an integration can only read material available to its technical identity, which does not establish which later chat users may see the same content.
  • Document supported and excluded object types; a clearly bounded connector is easier to operate than an undefined claim that “the whole wiki is connected.”

Start with an approved collection and concrete questions. The first important decision is not the language model. It is the contract between the source and retrieval system: which objects enter the collection, who may see them and how changes propagate.

01 / 14

Define the approved scope

Name the allowed spaces, page trees or data sources. An entire wiki often includes drafts, personal notes and historical material that should not carry the same authority as approved guidance. A smaller collection makes both business review and troubleshooting easier.

Decide whether child pages are automatically included. A child can contain a necessary exception or a confidential project area. Hierarchy alone does not establish approval. Specify whether comments, attachments and embedded external material are in scope.

Assign a business owner to every collection. That person resolves authority and conflicting versions. The technical operator should not decide what counts as company knowledge simply because an API call succeeded.

02 / 14

What must a Confluence import preserve?

Confluence Cloud provides defined endpoints for pages and metadata. Its documentation describes page and space permission requirements and paginated lists. Ingestion therefore needs both access handling and complete traversal. Atlassian: Confluence Cloud Pages API.

Retain stable page identity, version, title, space and original link alongside the text. Renaming a page should not automatically create a second knowledge source. A changed title can still affect retrieval and must be updated.

Evaluate the selected content representation with real examples. Tables, macros, embedded material and attachments may behave differently from plain prose. Retrieving the parent page successfully does not establish that every embedded fact reached the answer collection.

03 / 14

Why is a Notion page not one text field?

Retrieving a Notion page object returns properties; page content is obtained separately through blocks. The child-block documentation describes pagination and potentially recursive retrieval for nested content. Notion: retrieve a page, Notion: retrieve block children.

A page identifier and title therefore do not prove complete content ingestion. The importer must detect additional result pages and nested children. Otherwise an indented exception or a long table can disappear.

Notion's documented Search endpoint searches titles among objects shared with the connection. It is not arbitrary full-text search across every workspace item. Notion: search by title. Treat source discovery and the eventual RAG search as separate tasks.

04 / 14

Pagination affects substantive completeness

APIs commonly return larger collections in several portions. An importer that reads only the first can still appear healthy because some pages are present. The failure emerges only when someone asks about later entries.

Build a test collection deliberately larger than one response page. Compare expected and imported identifiers. Repeat for nested blocks and attachments where they are in scope. An identity-level reconciliation is more useful than a total count alone.

After interruption, the application must know which part is complete. Do not silently present a partially retrieved collection as a current complete view. Exclude the affected source temporarily or use an explicitly bounded state if the task permits that behavior.

05 / 14

How should Confluence and Notion permissions carry into RAG?

An integration can only read material available to its technical identity. That is a necessary restriction, but does not establish which later chat users may see the same content. A central service account may read more than an individual employee.

Permissions from Confluence and Notion can reach a RAG answer in the following ways:

  • Caller-context retrieval: the application retrieves in the context of the person asking.
  • Validated access metadata: the application enforces separately maintained, validated access metadata.
  • Collection approved for all intended users: a bounded starting option when necessary permission metadata is unavailable.

Choose between the first two. If a connector claims complete permission preservation, require evidence for restricted pages, nested areas, group changes, guest access and revocation. Mixing restricted and general content while expecting the prompt to separate it is not equivalent protection.

06 / 14

Which source metadata should a shared RAG index preserve?

A shared index for Confluence and Notion content should keep the following fields:

Field Purpose in the shared index
Source system Distinguish Confluence from Notion
Object identifier Preserve identity through renaming
Parent object Associate pages, blocks and attachments
Version or change state Detect obsolete derivatives
Original URL and section Open supporting evidence
Approval state and audience Define the answerable collection
Extraction status Expose missing portions

A common representation supports cross-platform search, but must not hide meaningful differences. A modification time is not a substitute for approval, and a block may only make sense with its page heading.

Preserve relationships needed to interpret the content. Citations should lead to a page or passage rather than a workspace homepage. Test the link with the same role that receives the answer.

07 / 14

A synthetic missing-exception example

A fictional Notion handbook states a general returns deadline in an ordinary paragraph. A nested section contains exceptions for custom-made products. Confluence also holds an older procedure without that exception.

A superficial importer reads the Notion paragraph, misses its children and retrieves the old Confluence page. The assistant can then produce a persuasive but wrong general commitment. A stronger model does not reliably repair missing source structure.

The correction begins with ingestion and authority. Include the nested section and mark the older source as historical. Then ask specifically about the custom-made product to verify that the exception and applicable version reach the answer. This is a proposed evaluation case, not a claimed integration result.

Got a workflow like this?

Tell me about it. Honest take and a rough price, usually within a day.

AI knowledge assistants →

08 / 14

Resolve cross-platform duplicates deliberately

Organizations often copy content while changing tools. Similar pages can therefore have different update histories. Decide which system remains authoritative for each process and how the other location should behave.

Similarity detection can identify candidate duplicates. It should not independently determine which policy is binding. Location-specific procedures may look similar while intentionally differing.

If both remain necessary, retain scope and their relationship. Retrieval can then select by task, location and date. One unlabelled summary merging both would lose the same business distinction again.

09 / 14

Combine change events with reconciliation

A running connector must handle edits, moves, archiving, deletion and revoked access. Available events depend on the interface. Notion provides documented webhooks, but using them still requires implementation and verification. Notion: webhooks.

Treat an event as a synchronization trigger rather than automatically assuming it contains the complete current content. Determine whether the object must be fetched again. Duplicate delivery must not produce duplicate search objects or repeated publication.

Add periodic reconciliation of the approved collection to detect missed events and inaccessible objects. An error state must not allow the most recently read confidential version to remain answerable indefinitely.

10 / 14

Distinguish outages from deletion

An unreachable page may be deleted, restricted or temporarily inaccessible because of a technical problem. Use documented interface responses and application state to distinguish these cases. Removing everything after a brief API outage can create unnecessary gaps.

Conversely, an unknown state must not become indefinite permission. Agree a conservative blocking rule for sensitive content and, where appropriate, a labelled older state for lower-risk material. Business impact and acceptable delay determine the fallback.

Show operators the source, affected collection and last complete successful retrieval. A generic “synchronization failed” message is difficult to act on. Recovery should identify and reconcile the missing portion.

11 / 14

Inspect attachments and embedded references separately

Scope decision. A page may point to an attachment without carrying its text. A link to another system may require a different identity or source approval. Decide whether the assistant should follow that link, cite it without reading it or state that the content is outside scope.

Linked destinations. Do not assume that access to the parent page authorizes retrieval from every linked destination. A controlled connector can maintain an allowed-source list and treat unsupported objects as explicit gaps. This is more useful than quietly dropping them while reporting complete ingestion.

Per attachment type. For each supported attachment type, compare extracted content with the original and test a question whose answer exists only there. This keeps attachment support tied to observable behavior rather than a file-extension list. Repeat this test when the extraction method or the API version in use changes. Attachments with the same name can also have different revisions and need a traceable version reference.

Recovery manifest. For recovery, retain a manifest of expected source objects and their last processed versions. This lets operators distinguish a deliberately excluded attachment from one lost during a failed run. Reconcile the manifest before reporting the collection complete, especially after changing extraction software or the API version.

12 / 14

How do you accept the connector against concrete cases?

Test collection. Include long pages, nested sections, tables, attachments, restricted content and renamed objects. Ask a question whose answer exists only in the final portion of a paginated response. This exposes incomplete traversal directly.

Change and revocation. Then change an important sentence and revoke a test user's access. Inspect stored summaries, citations and existing conversations as well as fresh search results. Measure the allowed propagation delay rather than taking it from a general product description.

Documented scope. Document supported and excluded object types. A clearly bounded connector is easier to operate than an undefined claim that “the whole wiki is connected.” The knowledge-base guide covers business ownership, and the freshness guide explains the operating lifecycle.

Version record. Record the API version and connector configuration alongside the tests. Platform capabilities evolve, and a future feature announcement does not establish the behavior of an older integration. Recheck representative cases when upgrading the connection or expanding its source scope.

13 / 14

Take the worksheet

Worksheet

Download the editable CSV table

PropertyPreserveTest
Page structureHeading contextAnswer in nested section
TableRow and column meaningSimilar values
AttachmentParent relationshipException in PDF
ChangeVersion and timeUpdated rule
AccessAllowed groupRestricted space

Columns to fill in, in the file: Your value / observation, Owner, Next action.

Download the editable CSV table (CSV). Add your own values, owners and open actions. This worksheet contains no measured client results.

14 / 14

These modernagents guides cover related decisions about AI knowledge assistants:

For a workflow review, start with the task, systems involved and typical exceptions. Discuss it with modernagents.

ShareEmail

Related reading

AI knowledge assistants

Got a workflow like this?

Tell me about it. Honest take and a rough price, usually within a day.

Robert Van Ysendyck · Founder & Managing Director