This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

LinkEnhancer

webtrees custom module: cross-references, enhanced links, markdown editor, and context-sensitive help

License: GPL v3 webtrees major version

note with linkssite title as link

small menu with help link
note with enhanced links and
image from media record
site title as home link
small menu with help link
Markdown editorMarkdown Help
markdown editormarkdown help

What this module does

This module wraps up some examples mentioned in the German Webtrees Manual and improves the application of these features — each component can be activated individually.

The main purpose is to make links to data records stored in family trees more convenient. This avoids having to store fully qualified links, which impairs the portability of GEDCOM data. By linking notes to GEDCOM data records (persons, families, sources, etc.) from the text, storytelling becomes much easier.

Support

  • Issues: for any ideas you have, or when finding a bug you can raise an issue.
  • Forum: general webtrees support can be found at the webtrees forum.

1 - Setup

Installation and requirements

What do we need to install this module and how to set it up correctly.

1.1 - Requirements

System requirements for the LinkEnhancer module

This module requires webtrees version 2.2 or 2.3. This module has the same requirements as webtrees#system-requirements.

It was initially created for version 2.2.4; since linkenhancer 1.6.1 it should also work with webtrees 2.3. Tests were usually run with built-in themes and some other custom modules.

Tip: It’s recommended installing the Cronjob module as well. This makes it easy to run the CLI scripts for maintaining the indexes.

1.2 - Installation

Step-by-step installation instructions
  • Install and use Custom Module Manager for an easy and convenient installation of webtrees custom modules.
  • Open the Custom Module Manager view in webtrees, select “linkenhancer”, and click on the “Install Module” button.

Manual installation

  1. Download the latest release of the module.
  2. Upload the downloaded file to your web server.
  3. Unzip the package into your modules_v4 directory.
  4. Rename the folder to linkenhancer

If everything was successful, you should see a subdirectory linkenhancer with the unpacked content in the modules_v4 directory.

Note: During the initial installation, the following problem may occur: “PDO error - There is no active transaction” — for more details see known issues.

1.3 - Admin settings

Webtrees module settings

At the top of the admin page, you can access the administrative Cross-Reference Overview and the Renumber xref_IDs (with references) function.
You can also enable or disable the basic features:

  1. Enhanced Links
  2. Markdown enhancements
  3. Help functions (German Webtrees Manual)
  4. Home Link
  5. UID Lookup

When the first four basic features are enabled, more detailed settings can be configured further down. There are also two global settings for debug output in the browser’s JavaScript console and the web server error log file, and you can choose whether links should always open in a new browser tab (it’s also possible to set different options for each core feature).

Below are the available options on the admin page:

admin page

Custom external targets

Here are two example entries from predefined targets to illustrate the principle who to provide additional external targets with an own custom JavaScript object.

{
    "fsft": {
        name: 'Family Search Tree - $ID',
            url: 'https://www.familysearch.org/tree/person/details/',
                cname: 'icon-fsft'
    },
    "wp": {
        name: 'Wikipedia',
            url: (id, title) => {
                let parts = id.split('/');
                if (parts.length < 2) {
                    title = title + " - " + options.i18n('syntax error') + "!";
                    return { url: '', title };
                }
                let subdomain = parts[0];
                let article = parts.slice(1).join('/');
                title = `${title} - ` + decodeURIComponent(article) + ` (${subdomain})`;
                return { url: `https://${subdomain}.wikipedia.org/wiki/${article}`, title };
            },
                cname: 'icon-wp',
                    help: [
                        { n: options.i18n('wp-help1'), e: 'de/Webtrees' },
                        { n: options.i18n('wp-help2'), e: 'en/Webtrees' },
                        { n: options.i18n('wp-help3'), e: 'other-subdomain/Webtrees' },
                    ]
    }
}

Property explanation (the syntax of a base enhanced link: #@param-key=param-value):

  • key — the short name or query parameter key (param-key)
  • name — title or label to be displayed as link title; the placeholder $ID is replaced by the given id (param-value)
  • url — service URL to be called; the parameter value / given record id (param-value) is appended to the end of the URL. It can also be a function that accepts (id, title) and returns an object { url, title }.
  • cname — CSS class name(s) whitespace separated
  • help — optional array of objects [{n:'', e:''},..] to illustrate the use of a non-standard target by examples (in e), provided with explanatory text (in n). Listed in the markdown help.

options.i18n is a function passed through from this module in order to provide translated strings.

Any CSS rules required are best added via the CSS and JS module. Only the definition of the icon (size 30 x 30 pixels is sufficient) as a background image is actually needed — referencing as data: URLs. For example: .icon-whatever { background-image: url(...) }

[2] Markdown enhancements

If you as a developer also want to apply the markdown editor (mde) to text areas on the edit pages of other custom modules, you can do so using the MarkdownEditorActivationService (available since v1.2.11 — details see #101):

<?php
private function toggleTinyMde(bool $enable, bool $force = false): void
{
    $class = "Schwendinger\\Webtrees\\Module\\LinkEnhancer\\Services\\MarkdownEditorActivationService";
    if (Registry::container()->has($class)) {
        /** @var MarkdownEditorActivationService $mde_service */
        $mde_service = Registry::container()->get($class);
        $existingRule = $mde_service->getCustomRule(self::CUSTOM_TITLE);
        if (
            $force ||
            $enable && !$existingRule ||
            !$enable && $existingRule
        ) {
            $mde_service->setCustomRule(
                self::CUSTOM_TITLE,  // module name as key
                $enable ? ["source-transcription-detail"] : [], // handler: route name
                $enable ? ["textarea[id$='_text']"] : [] // filter: querySelector
            );
        }
    }
}

This only works if this feature has been enabled globally and the edit page is associated with a tree that also uses Markdown in its notes.

You can view the registered users in the hidden text field below the radio buttons for enabling or disabling the option “Markdown editor for note textareas ” by hovering your mouse cursor over the area.

Known custom modules that make use of this feature:

[3] Webtrees manual

It is possible to import routes registered in webtrees on demand. This makes it easier to cover individual custom module configurations.

Furthermore you can import and export data in CSV format in order to make changes more convenient. You can define the separator and for import the character encoding (on export it is always UTF-8). You can see at a glance how many data rows are stored in the table and how many of them have a URL assigned.

admin page data table

In case of discrepancies the context help can be more easily adjusted by activating the option “Output of debug information on the JS console”. This provides you with information on the active route and, if applicable, data table entries found for matching routing to help topics.

Route-to-help mapping

The mapping of routes to help articles in the manual is stored in the database table le_route_help_map. This module comes with predefined mapping rules. If there is something missing or you find an issue, don’t hesitate to share it.

Technical background information follows. The table has the following headers (the headers required in a CSV file for import are marked with !!):

  • id: automatic key — not relevant, the data field is only used to make it easier to identify the data record during editing.
  • path !!: route path — corresponds to the path of webtrees pretty URLs
  • handler !!: usually corresponds to the PHP class name of the code that handles the request
  • method !!: web request method (GET, POST, HEAD). Only GET routes are generally relevant for assignment to manual sections.
  • extras !!: PHP class name of access level (Fisharebest\Webtrees\Http\Middleware\Auth*)
  • subcontext !!: CSS selector string or JSON object string to address a component/subcontext topic on the given page
  • category: string value for better grouping data rows; only value ‘generic’ has a special meaning
  • order !!: arbitrary numerical sort key, matching data rows are sorted in ascending order (standard value is 10)
  • url !!: path of the URL to the webtrees manual (concatenated with the given GenWiki base/domain URL). Also fully qualified URLs to other web resources are possible and supported.
  • updated_at: timestamp of last update — helps to identify possibly outdated data rows

As we can see in app/Http/Routes/WebRoutes.php, where standard webtrees routes are defined, for a route the following information is mandatory:

  1. path
  2. handler
  3. method

Optionally extras can be provided. If none of those four mentioned fields is set, the data row is filtered by the seeder. On import category and order are set automatically if not set.

In order to get a first class match with the current route, those four fields have to match.

Normally, it is only necessary to assign GET routes to an article. We also have a few redirect routes and ajax helper routes (which provide data for form controls) that can be ignored.

Special cases are the paths beginning with /module/{module}/{action} or /tree/{tree}/data-fix/{data_fix}: they are handled by an integrated proxy class that addresses the custom module by a route attribute:

For mapping such a route to a specific custom module help article the handler is set to the above mentioned route attribute value (e.g. _vesta_classic_look_and_feel_). For a more generic rule, path can also be empty (then one rule can be used for both cases).

Fallback rules for access levels are matched by category='generic' and the specific Auth classname in extras.

In ascending order the first rule where subcontext = '' is selected for the top menu link. If nothing else applies, the link points to the start page of the manual.

If activated, subcontext topics on a page can be provided with an additional help link. You can set a CSS selector string or a JSON object string with the following properties:

  • p: position of popover, optional (default is top, other possible values: left, right, bottom)
  • f: css selector/filter string (only necessary if you want the popover to be positioned differently) OR
  • e: javascript expression string

This is useful if there are components on the page that require more detailed information than offered by the help link in the top menu (e.g. for custom module functions on the individuals page). This help link is displayed in a popover (because an additional link does not always work in bootstrap tabs, accordion headers or menu titles).

Set category='generic' for rules that should apply to more than one page.

Table of contents (TOC)

This module downloads a multilingual table of contents for the German webtrees manual from a remote feed (JSON files: structure, language translations, and a version manifest). The data is cached locally and refreshed automatically:

  • On-the-fly: when a user views the TOC page and the cache has expired (24 h), the service checks the feed manifest (version.json) for per-file hash changes and re-downloads only the files that changed.
  • Proactive (cron): the refresh-wthb-toc cron job (daily at 03:00 by default) downloads all files regardless of cache state.

Auto-update toggle: the module admin page offers an “Auto-update” switch for the TOC data. When disabled, only locally cached data is served (no HTTP downloads). The admin Force refresh button and the CLI with --force still work regardless of the switch. Tip: refresh the data before disabling to ensure the latest version is cached.

CLI:

php modules_v4/linkenhancer/cli/refresh-wthb-toc.php              # scope from module pref
php modules_v4/linkenhancer/cli/refresh-wthb-toc.php --all        # all available languages
php modules_v4/linkenhancer/cli/refresh-wthb-toc.php --lang=en,fr # specific languages
php modules_v4/linkenhancer/cli/refresh-wthb-toc.php --clear      # only clear cache
php modules_v4/linkenhancer/cli/refresh-wthb-toc.php --force      # run even if auto-update is disabled

While auto-update is switched off, scheduled refreshes are skipped (the cron run exits 0 without doing work). --force refreshes anyway (e.g. to prepare for re-enabling), and --clear works regardless of the switch.

The module contains some standard external help links, that are defined in JSON — array of objects with the following members:

  • title: display text for the link, can also contain HTML (string, mandatory), language should be en-US; for standard link titles translations are provided
  • url: link to web resource (string, mandatory)
  • class: additional CSS class names (string, optional)
  • self: if set, link target is _self (opens in place), otherwise _blank (any type, optional)
  • i18n: overwrite title with user defined translation for given language tags (object, optional; keys are language tags, values are translated titles)

Example:

[
  {"title":"webtrees FAQ <i class=\"fa-solid fa-circle-question\"></i>",
   "url":"https://webtrees.net/faq/",
   "i18n": { "de": "webtrees Häufig-gestellte-Fragen <i class=\"fa-solid fa-circle-question\"></i>" }
  }
]

Dynamic CSS styles can be configured with a JSON object:

{ 
  "*": ".homelink { color: #039; }",
  "colors_nocturnal": ".homelink { color: antiquewhite; }"
}

Explanation: The object key name is set to the theme name to be matched, and the string value contains one or more CSS style rules. In this example we have a fallback rule with key * that matches all themes unless there is a specific key.

Theme colors is a special case, where we also have palettes. In order to address this combination the key is set to theme name_palette name. The key colors matches all subthemes.

Just activate the option “Output of debug information on the JS console” in order to figure out the correct values.

2 - Features

Overview of all LinkEnhancer features

2.1 - Enhanced Links

Cross-references and linkenhancer links in GEDCOM records

Although webtrees replaces XREFs such as @I2@ in notes with a cross-reference and its appropriate display name, this is not very flexible. You can’t determine the display name, which means that in the event of an error (due to XREF renumbering or typing error), it is not easy or possible to resolve the cross-reference to the corresponding data record without any doubt.

Tip: The custom module webtrees-mitalteli-show-xref can help you find the XREF and UID reference of personal data records. Some UIDs (38 characters length) are automatically shortened by webtrees in the standard view — this module shows the unchanged UIDs.

How it works

The enhanced links function is implemented via JavaScript and searches in the rendered output of webtrees for <a> tags whose href attribute values begin with #@. This way it is possible to handle links in markdown and HTML markup. Because it is processed in the browser on the client side, the existence of the cross-referenced data records in webtrees is not checked in advance. Errors only occur when the link is clicked (e.g. if the access to the resource is restricted).

As a bonus, different destinations can be addressed with one link definition, whereby the cross-reference is always the first link (if set) and the others are represented by attached clickable icons only.

Predefined external targets

The parameter keys are listed in parentheses:

Each parameter key can be specified multiple times — but you shouldn’t overdo it for the sake of clarity.

Additional external destinations can be configured on the Admin page.

Syntax

Markdown: An enhanced link looks like this [Link display title](#@param1&paramN), so that one or more targets can be addressed at once. For cross-references in webtrees a record reference (REF can be the XREF or a UID) is expected:

  • wt=@REF@ or wt=@REF@othertree — standard link, access to record page via redirect URL
  • wt=n@REF@ — legacy link with given record type (here: to a note with REF in the current tree)
    • Available record types: i=individual, f=family, s=source, r=repository, n=note, l=sharedPlace
  • wt=i@REF@othertree+dia — link to record type individual with REF from tree “othertree” and also link to Interactive tree of this person

HTML: The same applies to HTML links: <a href="#@wt=i@I1@">Link display title</a>

This is also usable in cooperation with the name badge function of the Vesta Classic Look & Feel module in the HTML snippet field: <a href="#@fsft=<ref/>"></a> for linking to a record in the Family Search Family Tree. It’s also possible to embed those links in news articles of Tywed’s news-menu module or in FAQ articles.

The syntax of the external targets is listed by the markdown help function of this module. In most cases, only one key-value parameter pair needs to be specified, consisting of the short name of the desired target and the ID of the data record located there.

Example

In the upper part of the image we can see the edit mode of a note record, below how it is rendered in view mode:

Note with enhanced links - edit and view

2.1.1 - Cross-Reference Overview

Cross-reference overview with link index for large trees

There are three types of overviews:

  1. overview about all data for the admin (admin overview),
  2. to one tree limited overview (user overview), and
  3. record-specific overview on the record details view (record overview, as tab or modal).

The admin overview (Control panel → LinkEnhancer → Cross-reference overview) is a server-side paginated DataTable. It lists all records that contain classic @XREF@ cross-references or linkenhancer links, with a per-record link inventory.

Optional filters:

  • referenced XREF (only available while a fresh link index is active — in live-scan mode the field is hidden, because it would only be a coarse pre-filter there — no classic references are found),
  • record type,
  • tree, and
  • the number of tokens shown per link class (all / 5 / 10 / 20, default 5).

The XREF cell shows the tree name as a second muted line; the type is its own sortable column. Each inventory token is displayed as a short display context (snippet) with the link token itself in bold.

Admin overview

Optionally you can enable a user overview per tree and a record overview with incoming and outgoing references per GEDCOM record. The record overview also displays the XREF and, if applicable, the UIDs of the record, so that these references can be more easily copied into notes.

Record overview

Supported engines

Live overviewLink index (CLI)
MariaDB / MySQLyes (REGEXP gate)yes
PostgreSQLyes (REGEXP gate)yes
SQLite / SQL Serverlimited mode — automatic fallback to a coarse LIKE gate + full table scan per request (banner on the page); the exact classification still happens in PHPnot available (needs REGEXP + MD5) — the CLI exits with an error

How it works

On large trees the live regex scan over the GEDCOM tables can be slow, so the page can instead read a link index made of three module tables (the Developer / Project Structure section contains more details about the database schema):

  • le_record_scan — one row per scanned record with an MD5 fingerprint of the record text
  • le_link_index — one row per (link, target) found in the record (the display context captured at build time) — the foundation for displaying incoming cross-references in the record overview
  • le_index_meta — single row — the state of the last complete index run
flowchart TD
    CLI["🛠 cli/build-link-index.php<br/>Cron: */30 * * * *"]

    subgraph Scan["🔍 Incremental scan"]
        FP["MD5 Fingerprint<br/>per record"]
        DIFF{"🔀 Changed?<br/>(new / removed)"}
    end

    subgraph Tables["💾 Tables"]
        RS[("le_record_scan<br/>file, xref, hash")]
        LI[("le_link_index<br/>token, target, snippet")]
        META[("le_index_meta<br/>last_run, rows")]
    end

    PAGE["📄 XREF Overview Page"]

    CLI --> Scan
    FP --> DIFF
    DIFF -->|✅ yes| SCAN["PHP Scan<br/>(XrefsService)"]
    DIFF -->|⏭ no| SKIP["skip"]
    SCAN --> RS
    SCAN --> LI
    CLI --> META

    META -->|"🟢 fresh (< 2 h)"| PAGE
    META -->|"🟠 stale"| LIVE["Live Regex Scan"]
    LIVE --> PAGE

    classDef scanStyle fill:#e3f2fd,stroke:#1565C0,stroke-width:2px
    classDef tablesStyle fill:#e8f5e9,stroke:#2E7D32,stroke-width:2px
    classDef decideStyle fill:#fff3e0,stroke:#E65100,stroke-width:2px
    classDef pageStyle fill:#fce4ec,stroke:#C2185B,stroke-width:2px

    class FP scanStyle
    class RS,LI,META tablesStyle
    class DIFF decideStyle
    class PAGE pageStyle

The index is maintained by build-link-index.php :

  • Initial build (first run, or --rebuild): both index tables are reset, all scan rows are created server-side in one bulk statement per GEDCOM table (fast, zero row transfer), and only the records that pass the link pre-filter are scanned in PHP. The initial build is a one-time cost — use a higher --limit for it. If it is interrupted by --limit, the next run converges (the build is idempotent).
  • Incremental runs (the normal cron case): only records whose MD5 fingerprint changed — or which were added/removed — are re-scanned (cursor chunked), so the job stays cheap even on large sites.

Cron example (every 30 minutes, up to 2000 records per run):

*/30 * * * * cd /path/to/webtrees && php modules_v4/linkenhancer/cli/build-link-index.php --limit=2000 >> /var/log/linkenhancer-index.log 2>&1

Only a full run (without --tree) that is not cut by --limit marks the index fresh (le_index_meta.last_run). A run cut by --limit continues where it stopped; a --tree run only refreshes that tree.

Flushing

--flush empties the index tables and exits (no rebuild) — for testing (force the page onto the live scan) and maintenance (clean restart, broken index):

php modules_v4/linkenhancer/cli/build-link-index.php --flush            # all trees
php modules_v4/linkenhancer/cli/build-link-index.php --flush --tree=5   # only tree 5

The freshness flag is always reset, so the page reliably falls back to the live scan afterwards. The next full run is an initial build again (full re-scan cost). --flush combined with --rebuild is redundant — --rebuild already resets and rebuilds.

The overview and the index use one shared pre-filter (single source: XrefsService::linkPrefilterPatterns()):

  • NOTE (level >= 1) with an @XREF@ or a ](#@ link, with content on the same line. A NOTE value that is exactly one reference (1 NOTE @N5@) is a GEDCOM shared-note pointer — a structural reference, not a text link, and is not listed.
  • CONC/CONT/TEXT/_TODO with an @XREF@ (naked is a link) or a ](#@ link
  • an LE link may carry an optional id=@XREF@ parameter (at most one, the position among the parameters does not matter) — like the wt= parameters it is indexed as a link target
  • a shared note’s own level-0 text (0 @N1@ NOTE …)
  • matching is line-based (no cross-line matches), on the same lines the collector reads

The page shows which source it uses:

  • index active (green note): a full, complete index run finished less than 2 hours ago (default; XrefsService::INDEX_FRESH_SECONDS)
  • live scan (blue note): no fresh index — the page falls back to the live scan
  • limited mode (yellow note, SQLite/SQL Server): see the engine table above

Use p1-measure.php (read-only) on your instance to check how expensive the live scan is for your data and to calibrate the cron schedule.

2.1.2 - Renumber XREFs (with links)

Renumber XREFs with automatic link repair

The standard webtrees renumbering (Control panel Manage family trees → [Family tree] → Renumber XREFs) resolves cross-tree XREF collisions but does not update linkenhancer or classic links. This module provides an extended renumber that repairs all affected links in one step.

Access: Control panel → LinkEnhancer → Renumber XREFs (with links)

Workflow:

  1. Select the tree that has XREF collisions (duplicate XREFs with other trees).
  2. The page shows each conflicting XREF, its record type, and the number of inbound linkenhancer references from the link index.
  3. On submit, each conflicting XREF is:
    • renamed in the GEDCOM core tables (same as the standard renumber)
    • all wt=@XREF@ / id=@XREF@ links in notes and blocks are updated
    • the link index (le_link_index) and UID index (le_uid_index) are repaired inline or deferred to cron
  4. Each renumbered record is logged in the edit log (Admin → Changes log), e.g. Renumbered @I456@ → @I457@ (INDI, 3 core rows, 2 links).
  5. If the PHP time limit is reached, the run stops with partial progress — the remaining conflicts are renumbered on the next run.

Note: The standard webtrees renumber (without links) remains available and is unaffected. Use this module’s renumber when your notes or blocks contain linkenhancer links. See also: fisharebest/webtrees#5156

2.1.3 - Data Fixes

Data-fix handlers for link integrity issues

The module provides a set of data-fix handlers accessible from the webtrees data-fix interface (Control panel → Data fixes → LinkEnhancer). Each handler addresses a specific link integrity issue:

FixWhat it does
XREF ⇄ UID reference swapConverts linkenhancer link targets between XREF and UID form. Direction is selectable (XREF→UID or UID→XREF). Requires the UID index to be built.
Fix wt= type letterSets, repairs, or removes the legacy type letter in wt=<type>@REF@ links. Modes: set (add missing type), repair (fix wrong type), remove (strip type letter).
Report dangling link targetsReport-only: lists linkenhancer links whose target record no longer exists. No changes are made.
Report ambiguous UID targetsReport-only: lists links whose UID target resolves to more than one record. No changes are made.
Report duplicate UIDs in indexReport-only: lists UIDs assigned to multiple records in the UID index. No changes are made.

Each fix follows the webtrees data-fix workflow: select fix type → preview → apply. The data-fix page also shows the current status of the link and UID indexes, and whether index updates will be deferred to the cron job.

2.2 - Markdown

Markdown rendering in note records
Markdown logo

Markdown is a simple system of formatting, used on websites such as Wikipedia or GitHub. It uses unobtrusive punctuation characters to create headings and sub-headings, bold and italic text, lists, tables, etc.

Webtrees uses a CommonMark implementation and supports a subset of the markup. It is optionally supported in note records on a per-tree basis.

On the subject of markdown, see also:

Note: For the Markdown Image Support and the additional Markdown Extensions the MarkdownFactory class needs to be extended by this module. This replacement class also fixes fisharebest/webtrees#4841, so that a pre-formatted markdown block is not rendered as a single line anymore.

2.2.1 - Markdown Image Support

Embed images from GEDCOM media records or public folder in notes

note with links

This feature allows you to easily embed images from GEDCOM media records (which reside behind the media firewall) or from the public directory into notes. If restriction rules apply to the record, instead of the image, a message is displayed.

Syntax:

  • ![alternate text for gedcom object](#@id=@M1@)
  • ![alternate text for picture in public folder](#@public=webtrees.png "title")
  • ![picture with defined height, width and additional css class](#@id=@M1@&h=200&w=200&cname=float-right)

Technically the images are packed into a div container together with an image subtitle — which is also a link to the media data set for GEDCOM objects. The display can be customized as required using the standard CSS classes or per-image additional CSS classes (e.g. float-start or float-end from webtrees vendor.css).

2.2.2 - Markdown Editor

Visual markdown editor (TinyMDE) for note textareas

You can enable a visual markdown editor (mde) for note textareas. Under the hood the project TinyMDE - A tiny, dependency-free embeddable HTML/JavaScript Markdown editor is used.

Markdown editor

Besides syntax highlighting it ships with an icon bar for common format commands, a help popup and line numbering.

Markdown Help

Note: Unfortunately, the on-screen keyboard does NOT work as before with the previous text input field. The selected characters end up as an intermediate step in the small text field below the Markdown editor and then must be copied manually to the desired position.

2.2.3 - Markdown Extensions

Strikethrough, description lists, footnotes, highlight, TOC, smart punctuation

Warning: Please keep in mind when using these extensions, you are deviating from the smallest common markdown dialect set. If the library used to render markdown in HTML needs to be changed for any reason, there is a possibility that not all of the extended markup used here will be supported (see also #32). Since the markup is not intrusive, the impact should not be serious — of course, it’s a minor drawback.

The package League\CommonMarkdown used for processing Markdown texts offers several useful extensions that can be activated optionally:

You can activate all or a few selected of these extensions. As far as possible they are of course integrated with the markdown editor and you find additional information in the markdown help.

Footnotes

Footnotes can be placed near their references (there can be one or many references to one footnote) or everywhere you want. For the overview, it is advisable to place them at the bottom. When rendering, the footnote container resides at the end of the content.

Table of Contents

If your text is structured with headings, it is a good choice to activate the table of contents extension. The table of contents is generated automatically and included into the content above the very first heading or instead of a placeholder.

2.2.4 - Table cell height control

For longer markdown note texts it’s sometimes a pain to scroll through if you are interested in the next facts beneath them at the moment. This feature should come in handy here: By activating the checkbox in the top right corner of the title cell (first table column), the maximum height of the content cell with the long note is set to about 80% of the viewport height. This makes the content itself scrollable.

Where applicable, the function can be activated by default (or simply made available) and can also be deactivated independently.

Markdown table cell height control

In combination with the table of contents extension (position = dropdown), you can navigate through the text easily — assuming the text is structured with headings.

You can decide if the checkbox is always visible or hidden until you hover the fact title cell with the mouse cursor. If the text length of the content cell doesn’t exceed the defined maximum height, the checkbox can not be activated.

2.3 - German webtrees manual (WTHB)

Context-sensitive help links to the German webtrees manual
CompGen logo

A context sensitive help link to the German webtrees manual can be added to the small navigation menu. Context links are also available for components on pages provided by custom extensions (e.g. on the individuals page, the start page or items in the main menu) — these can be identified by the i symbols in a circle.

small menu with help link

WTHB subcontext help

To ensure that this function is also available in the admin backend, a modified version of views/layouts/administration.phtml must be registered. This module attempts to use the custom module vesta_common (if installed and enabled) or its own version of the view layout file. Alternatively, patch P002 could also be applied to the core code.

If the webtrees page is displayed in a language other than German, it is possible to open the webtrees manual URL via a translation service (Google Translate). This can be enabled or disabled as a site setting or delegated to the visitor to decide.

Note: Due to AI bot restrictions on the GenWiki, this feature is currently useless.

WTHB user setting

The settings dialogue can be accessed via the help submenu in the top menu. When this option is enabled, you will also find a link to a dialogue box that displays a full-text search in the German webtrees manual (using various search engines) and the table of contents. How the TOC itself is produced (GenWiki round trip, generation, Weblate) is documented on the WTHB TOC Language Pipeline page.

WTHB full-text search and toc

In addition, the submenu contains an overview of the help topics included in webtrees and customisable external help links (e.g. webtrees FAQ and forum, GitHub repo, etc.). The top menu item can be split into two links — one to directly open the context help article and the other to open the submenu.

WTHB submenu and split menu item

2.4 - Home Link

Site title as a configurable link with theme-aware CSS

The site title can be a link to the tree homepage or the user my page. The webmaster can also set a user-defined URL.

site title as link

Dynamic CSS styles can be applied to match the current theme, ensuring that the display contrasts well. Of course it is not limited to the home link use case - for details see Admin settings.

2.5 - UID Lookup

Navigate to a record by its persistent UID

A UID (_UID in GEDCOM 5.5.1, UID in GEDCOM 7.0) is a persistent identifier assigned to a record. The UID survives XREF renumbering and tree migrations, making it a stable reference point.

This feature allows navigating directly to a record by its UID. The URL pattern is:

  • /tree/{tree}/goto-uid/{uid} — scoped to one tree
  • /goto-uid/{uid} — global (searches all trees)

Behavior:

  • 0 hits → 404
  • 1 visible hit → redirect to the record
  • >1 visible hit → selection list (case-variant UIDs or the same UID in multiple records)

UID comparison is case-insensitive (GEDCOM specs do not define UID as case-sensitive). The stored value is verbatim; matching is done case-insensitively so that case-variant UIDs return a selection list rather than a possibly-wrong single redirect.

You can look up UIDs via the quick search input. For shorter UIDs that can be regarded as XREFs, the prefix uid: can be added to the search value.

Standard navigation (goto-id)

goto-id is the standard navigation target for every linkenhancer link — both untyped (wt=@REF@) and typed (wt=<type>@REF@) — and resolves a reference that is either a record XREF or a UID. The URL pattern is:

  • /tree/{tree}/goto-id/{id} — scoped to one tree (falls back to a global lookup when nothing is found in the tree, with a flash notice)
  • /goto-id/{id} — global (searches all trees)

Behavior (shared IdResolver): the id is tried length-aware and bidirectionally — a long id (≥ 18 chars) as a UID first, a short one as an XREF first — and falls back to the other when the first yields nothing, so a resolution is never lost. 0 hits → 404, 1 visible hit → redirect, >1 → selection list.

sequenceDiagram
    autonumber
    participant U as 👤 User (Browser)
    participant JS as LE JavaScript
    participant WT as webtrees Server
    participant IR as IdResolver
    participant DB as Database

    Note over U,JS: Click on an LE link
    U->>JS: Click on #@wt=@I234@
    JS->>JS: detect href "#@…"
    JS->>WT: GET /tree/5/goto-id/I234
    WT->>IR: resolve("I234", tree=5)

    alt ID short (< 18 chars) → try as XREF first
        IR->>DB: SELECT … WHERE xref = 'I234'
        DB-->>IR: Match?
    else ID long (>= 18 chars) → try as UID first
        IR->>DB: SELECT … FROM le_uid_index WHERE uid = '…'
        DB-->>IR: Match?
    end

    alt ✅ 1 match
        IR-->>WT: Record
        WT-->>U: Redirect to record page
    else 0 matches → Fallback
        IR->>IR: try the other direction (XREF ⇄ UID)
    else >1 matches
        WT-->>U: selection list
    end

    Note over IR,DB: Bidirectional — XREF ⇄ UID<br/>a lookup is never lost

A typed wt=<type>@REF@ link is a legacy form: the type letter is no longer used for routing (all links go through goto-id) and is only documentary — it still drives the diagram link for individuals and the type-mismatch hint in the cross-reference overview. New links should use the untyped wt=@REF@ form.

XREF route (goto-xref)

There is also the route /tree/{tree}/goto-xref/{xref} available, which allows you to navigate to the corresponding record in the tree, regardless of the record type.

Cross-reference overview: UID targets in other trees

In the admin Cross-Reference Overview a link whose UID target is not found in the record’s own tree is normally shown as “target not found”. When the UID feature is enabled, such a target is additionally resolved globally (across the other trees); if matches exist it is rendered as not unique (?) with the match count instead: up to 3 matches are listed as direct cross-tree links, more than 3 collapse into a single goto-id link (title = the UID). This behavior is hard-gated on the UID feature preference and never applies to targets that name an explicit tree.

Index

The UID index is stored in the le_uid_index table (one row per UID tag occurrence, distinguished by tag_path). It is maintained exclusively by build-uid-index.php (no live scan on request).

  • Initial build (first run, or --rebuild): full scan of all GEDCOM tables, extracting all UID tags via UidTagCollector.
  • Incremental runs: only records whose MD5 fingerprint changed (or were added/removed) are re-scanned.

Cron example (every 10 minutes, up to 5000 records per run):

*/10 * * * * cd /path/to/webtrees && php modules_v4/linkenhancer/cli/build-uid-index.php --limit=5000 >> /var/log/linkenhancer-uid-index.log 2>&1

The feature can be toggled on/off in the module admin page (“Activate Support” → [5] UID lookup). The current index status (row count, last build time) is shown there.

While the feature is switched off, index builds are skipped automatically (the cron run exits 0 without doing work). --force builds the index anyway (e.g. to prepare for re-enabling), and --flush works regardless of the switch.

Note: UID tags at any nesting level are indexed (e.g. 0 @I1@ INDI, 1 _UID, 1 FAMF, 2 _UID). The tag path is stored per row so duplicates are distinguishable in the selection list.

2.6 - Patches

Optional webtrees core patches

The patches can be applied additionally — the module also works without them!

The util subfolder contains minor patches for the webtrees core. These are diff-files that can be easily applied or removed using shell from within the installed module folder (necessary for auto-detecting webtrees sources):

Usage: util/wt-patch.sh [-R] [FILTER]
  -R                  undo Patch (patch -R)
  FILTER              '*' for all or specific (e.g. '01')

Don’t forget to reapply the patches after updating webtrees.

These are minor bug fixes or functional enhancements — usually in a single file — that are intended to bridge the gap until they are officially fixed/implemented in the webtrees core.

#DescriptionApplies to version
P001Backlink for level 1 shared notes #5181 — not necessary anymore except you would like to have an additional edit link. app/Fact.php2.2.1 - 2.2.6
P002Enable headContent/bodyContent for this module on admin backend in order to show the context help link #5214. resources/views/layouts/administration.phtml2.2.1 - 2.2.6
P003Record has multiple uid fields #4828. app/Services/GedcomEditService.php2.2.1

3 - Developer

Development documentation

3.1 - CLI Scripts

Command-line maintenance scripts

The module ships CLI-only scripts. They are guarded: requested over HTTP (the modules_v4 directory is inside the web root) they answer 403 instead of running.

ScriptPurposeNeeds a webtrees install + DB?
cli/build-link-index.php [--limit=N] [--tree=<id>] [--rebuild] [--flush]build/update the link index for the XREF overviewyes
cli/build-uid-index.php [--limit=N] [--tree=<id>] [--rebuild] [--flush] [--force]build/update the UID index for UID lookupyes
cli/refresh-wthb-toc.php [--all] [--lang=<list>] [--clear] [--force]refresh the WTHB table of contents cache (production)yes
test-text-tag-collector.phpstandalone unit tests for the text-tag collectorno
test-link-classifier.phpstandalone unit tests for the link classifier (incl. target extraction)no
test-uid-tag-collector.phpstandalone unit tests for the UID tag collectorno
test-uid-index-service.phpstandalone unit tests for the UID index serviceno
tests/smoke-text-tag-collector.php [limit]scan records containing enhanced links, print every captured valueyes
smoke-migration5.phpSQLite smoke test for Migration5 (UID index schema)yes
tests/p1-measure.php [--tree=<id>]read-only scaling measurement for the XREF overviewyes

Run them from the webtrees root with the same PHP version the instance runs on (webtrees requires PHP 8.3+):

php modules_v4/linkenhancer/tests/test-text-tag-collector.php
php modules_v4/linkenhancer/tests/smoke-text-tag-collector.php 10

Cron example (every 2 hours, 500 records per run):

15 */2 * * * cd /path/to/webtrees && php modules_v4/linkenhancer/cli/<name>.php --limit=500 >> /var/log/linkenhancer-<name>.log 2>&1

3.2 - Contributing

How to contribute to the LinkEnhancer module

If you’d like to contribute to this module, great! You can contribute by:

  • Contributing code — check out the issues for things that need attention. If you have changes you want to make not listed in an issue, please create one, then you can link your pull request.
  • Testing — it’s all manual currently, please create an issue for any bugs you find.

Translation

You can contribute to this project on Codeberg Weblate. Updated translations will be included in the next release of this module.

Beside English the following languages are available:

  • Catalan (by Bernat Josep Banyuls i Sala)
  • Dutch (by TheDutchJewel)
  • Español (by Bernat Josep Banyuls i Sala)
  • German

Repository

Primary Repository: https://codeberg.org/bschwede/linkenhancer

All activity happens on Codeberg:

Mirror Repository: https://github.com/bschwede/linkenhancer

3.3 - Project Structure

Directory layout, dependencies and database schema

Directory layout

linkenhancer/
├── module.php            ← webtrees entry point
├── autoload.php          ← PSR-4 autoloader
├── cron-jobs.php         ← cronjob self-registration manifest
├── latest-version.txt    ← current version (synced to LinkEnhancerModule.php)
├── composer.json         ← PHP deps (wt-shared-libs, phpstan)
├── package.json          ← JS deps (gulp, rollup, mocha)
├── gulpfile.mjs          ← build tasks
├── phpstan.neon          ← static analysis config
├── phpstan-bootstrap.php ← PSR-4 bootstrap for PHPStan
├── phpstan-baseline.neon ← known issues
├── src/                  ← PHP (PSR-4)
│   ├── LinkEnhancerModule.php
│   ├── LinkEnhancerModuleExt.php
│   ├── LinkEnhancerUtils.php
│   ├── SettingInterface.php
│   ├── CommonMark/       ← CommonMark extensions
│   ├── DataFix/          ← data-fix handlers + dispatcher
│   ├── Factories/        ← CustomMarkdownFactory
│   ├── Http/             ← request handlers
│   ├── Schema/           ← Migrations + SeedHelpTable
│   └── Services/         ← business logic
├── resources/
│   ├── js/               ← JS source (src/) + build output (bundle-*)
│   ├── css/              ← CSS source + build output
│   ├── lang/             ← .pot / .po / .php (translations)
│   ├── views/            ← PHTML views
│   └── img/              ← screenshots
├── cli/                  ← CLI maintenance scripts
├── tests/                ← standalone + smoke tests
└── util/                 ← build/maintenance shell scripts

Dependencies

Database schema

The module owns five tables (prefix le_), created incrementally by src/Schema/Migration#.php. Every migration is additive and idempotent, so the schema converges on each module load.

le_route_help_map

Maps a webtrees route (path / handler / method) to a help entry — the backing store for context-sensitive manual help. Seeded by SeedHelpTable.

ColumnTypeNotes
idint, PK (auto)
pathvarchar(255)route path
handlervarchar(150)fully-qualified handler class
handler_keyvarchar(150), indexversion-neutral key (2.2.6 + 2.3 compatible)
methodvarchar(20)
extrasvarchar(60)
subcontextvarchar(250)
categoryvarchar(60)standard / custom module / generic …
orderint, default 10
urlvarchar(250)
updated_attimestamp, nullable

Index on (path, handler) and on handler_key.

le_record_scan

One row per scanned GEDCOM record, with an MD5 fingerprint of the record text — lets the CLI index diff incrementally.

ColumnTypeNotes
fileinttree id (part of PK)
xrefvarchar(20)(part of PK)
rectypevarchar(15)GEDCOM tag, e.g. INDI, OBJE (part of PK)
hashvarchar(32)MD5 of the record text
scanned_attimestamp, nullable

Primary key (file, xref, rectype).

One row per (link, target) found in a record — the foundation for the planned Backlink feature.

ColumnTypeNotes
idint, PK (auto)
fileinttree id
xrefvarchar(20)
rectypevarchar(15)
tag_pathvarchar(255)where the link sits in the record
link_classvarchar(10)xref / ext / pic / classic / other
tokentextthe raw link token
snippettext, nullabledisplay context captured at build time
target_xrefvarchar(20), nullableXREF link target
target_treevarchar(255), nullable
target_uidvarchar(255), nullable, indexUID link target (filled by a length heuristic)

Indexes on (file, xref, rectype), target_xref and target_uid.

le_uid_index

One row per UID tag found in a record (record-level and fact-level). No unique constraint — UIDs are not guaranteed to be unique.

ColumnTypeNotes
idint, PK (auto)
fileinttree id
xrefvarchar(20)
uidvarchar(255), indexverbatim UID value (no normalization)
rectypevarchar(15)
tag_pathvarchar(255)
hashvarchar(32)MD5 fingerprint (incremental change detection)

Indexes on uid and (file, xref, rectype).

le_index_meta

A single row (id = 1) holding the freshness state of both the link index and the UID index.

ColumnTypeNotes
idint, PK, default 1single row
last_runtimestamp, nullablelast complete link-index run
rowsint, default 0link-index row count
uid_last_runtimestamp, nullablelast complete UID-index run
uid_rowsint, default 0UID-index row count

3.4 - Class Hierarchy

Auto-generated class overview

Auto-generated by docs/tools/generate-class-hierarchy.php — do not edit manually.

Module

  • LinkEnhancerModule extends AbstractModule implements MiddlewareInterface, ModuleCustomInterface, ModuleGlobalInterface, ModuleConfigInterface, ModuleDataFixInterface, ModuleListInterface, ModuleTabInterface, SettingInterface — LinkEnhancerModule.php
  • SettingInterface — SettingInterface.php
  • LinkEnhancerUtils — LinkEnhancerUtils.php
  • LinkEnhancerModuleExt extends LinkEnhancerModule implements ModuleExtGlobalInterface — LinkEnhancerModuleExt.php

CommonMark (Extensions)

  • LeImageRenderer (final) implements NodeRendererInterface, XmlNodeRendererInterface, ConfigurationAwareInterface — CommonMark/LeImageRenderer.php
  • SmartPunctHelper — CommonMark/SmartPunctHelper.php
  • LeTableOfContentsRenderer (final) implements NodeRendererInterface, XmlNodeRendererInterface — CommonMark/LeTableOfContentsRenderer.php

Factories

  • CustomMarkdownFactory extends MarkdownFactory — Factories/CustomMarkdownFactory.php

Request Handlers

  • DataFixBlocksAction implements RequestHandlerInterface — Http/RequestHandlers/DataFixBlocksAction.php
  • HelpWthbAction implements RequestHandlerInterface — Http/RequestHandlers/HelpWthbAction.php
  • XrefDetailData (final) implements RequestHandlerInterface — Http/RequestHandlers/XrefDetailData.php
  • XrefOverviewListData (final) implements RequestHandlerInterface — Http/RequestHandlers/XrefOverviewListData.php
  • GotoIdTreeAction extends GotoIdAction — Http/RequestHandlers/GotoIdTreeAction.php
  • GotoUidTreeAction extends GotoUidAction — Http/RequestHandlers/GotoUidTreeAction.php
  • GotoXrefAction implements RequestHandlerInterface — Http/RequestHandlers/GotoXrefAction.php
  • DataFixRebuildIndexAction implements RequestHandlerInterface — Http/RequestHandlers/DataFixRebuildIndexAction.php
  • RenumberActionHandler (final) — Http/RequestHandlers/RenumberActionHandler.php
  • HelpMdAction implements RequestHandlerInterface — Http/RequestHandlers/HelpMdAction.php
  • AdminXrefOverviewData (final) implements RequestHandlerInterface — Http/RequestHandlers/AdminXrefOverviewData.php
  • GotoIdAction extends AbstractGotoAction — Http/RequestHandlers/GotoIdAction.php
  • HelpWtCoreAction implements RequestHandlerInterface — Http/RequestHandlers/HelpWtCoreAction.php
  • WthbAdminHandler (final) — Http/RequestHandlers/WthbAdminHandler.php
  • GotoUidAction extends AbstractGotoAction — Http/RequestHandlers/GotoUidAction.php
  • AbstractGotoAction (abstract) implements RequestHandlerInterface — Http/RequestHandlers/AbstractGotoAction.php

Schema

  • SeedHelpTable implements SeedInterface — Schema/SeedHelpTable.php
  • Migration6 implements MigrationInterface — Schema/Migration6.php
  • Migration2 implements MigrationInterface — Schema/Migration2.php
  • Migration7 implements MigrationInterface — Schema/Migration7.php
  • Migration3 implements MigrationInterface — Schema/Migration3.php
  • Migration4 implements MigrationInterface — Schema/Migration4.php
  • Migration1 implements MigrationInterface — Schema/Migration1.php
  • Migration5 implements MigrationInterface — Schema/Migration5.php
  • Migration0 implements MigrationInterface — Schema/Migration0.php

Services

  • AdminSettingsBuilder (final) — Services/AdminSettingsBuilder.php
  • MarkdownEditorActivationService (final) — Services/MarkdownEditorActivationService.php
  • IndexRebuildScheduler (final) — Services/IndexRebuildScheduler.php
  • UidTagCollector (final) — Services/UidTagCollector.php
  • TextTagCollector (final) — Services/TextTagCollector.php
  • ContentBuilder (final) — Services/ContentBuilder.php
  • RenumberWithLinksService (final) — Services/RenumberWithLinksService.php
  • DataFiles (final) — Services/DataFiles.php
  • XrefOverviewColumns (final) — Services/XrefOverviewColumns.php
  • LinkIndexService (final) — Services/LinkIndexService.php
  • XrefsService (final) — Services/XrefsService.php
  • XrefDetailService (final) — Services/XrefDetailService.php
  • WthbService — Services/WthbService.php
  • IdResolver (final) — Services/IdResolver.php
  • LinkRenderer (final) — Services/LinkRenderer.php
  • WthbTocService (final) — Services/WthbTocService.php
  • UidIndexService (final) — Services/UidIndexService.php

DataFix

  • FixHandlerInterface — DataFix/FixHandlerInterface.php
  • DataFixDispatcher — DataFix/DataFixDispatcher.php
  • TreeLookupTrait — DataFix/TreeLookupTrait.php
  • DanglingLinksFix (final) implements FixHandlerInterface — DataFix/Handlers/DanglingLinksFix.php
  • DuplicateUidFix (final) implements FixHandlerInterface — DataFix/Handlers/DuplicateUidFix.php
  • WtTypeFix (final) implements FixHandlerInterface — DataFix/Handlers/WtTypeFix.php
  • XrefUidSwapFix (final) implements FixHandlerInterface — DataFix/Handlers/XrefUidSwapFix.php
  • AmbiguousUidFix (final) implements FixHandlerInterface — DataFix/Handlers/AmbiguousUidFix.php

3.5 - Development Environment

Setting up a local development environment

What you need to build and test the module locally.

Requirements

ComponentVersionNotes
PHP8.3+same version the webtrees instance runs on
Composer2.xinstalls wt-shared-libs + phpstan
Node.js18+ (LTS)for Gulp / Rollup / Mocha
webtrees2.2.x or 2.3.xneeded for PHPStan (app/ classes) and the smoke tests
wt-shared-libsnewest versionsibling repo at modules_v4/wt-shared-libs (composer path repo)

Location

The module lives inside a webtrees installation at modules_v4/linkenhancer/. Its composer.json pulls in the sibling shared library as a local path repository:

"repositories": [
    { "type": "path", "url": "../wt-shared-libs", "options": { "symlink": false } }
]

Setup

# PHP dependencies (installs wt-shared-libs + phpstan)
composer install

# JS dependencies (gulp, rollup, mocha, …)
npm ci

Note: composer.json sets prepend-autoloader: false — the module’s autoloader is attached to (not replacing) webtrees’ autoloader.

Bind mount

In the current setup, development is being done on Linux with the Apache web server installed natively.The source tree is exposed to the PHP runtime through a bind mount of the rpo folders into modules_v4. Run the CLI tools and PHPStan from the mount path (the path the webtrees instance sees), not the source path, so app/ and vendor/autoload.php resolve:

cd /path/to/webtrees/modules_v4/linkenhancer
composer analyse

See the CLI Scripts and PHPStan pages for the exact commands.

3.6 - Build System

Gulp tasks for JS/CSS bundling, translations and versioning

Bundling, translation compilation and versioning are driven by Gulp tasks in gulpfile.mjs , invoked with npx gulp <task>. The npm run * scripts cover testing only — see the Testing page.

Tasks

TaskCommandWhat it does
buildnpx gulp buildclean → JS (Rollup) + CSS (PostCSS)
devbuildnpx gulp devbuildlike build, but Dev-Mode (no minify, source maps)
updateponpx gulp updateporuns update-po-files.sh → xgettext over src/ → messages.pot
po2phpnpx gulp po2phpcompiles resources/lang/*.po → resources/lang/*.php
syncversionnpx gulp syncversionkeeps latest-version.txt ↔ LinkEnhancerModule.php in sync
bumpversionnpx gulp bumpversionrequires a clean git tree → version bump → syncversion
archivenpx gulp archivebuild + po2php + create-archive.sh (release ZIP)
forgejo:issue-refsnpx gulp forgejo:issue-refs[:dry]adds issue refs to commit messages (needs FORGEJO_TOKEN in .env) - was used only once to migrate the repo from GitHub to Codeberg

JS / CSS bundling

build = clean → (in parallel) JS + CSS.

  • clean deletes resources/js/bundle* and resources/css/bundle* first.
  • JS (Rollup): two entry bundles — jsIndex (the main index-le.js ) and jsExtractLeConfig (le-config.js ). Output to resources/js/bundle*.
  • CSS (PostCSS): per-file subtasks from getCssSubTasks(), with autoprefixer + cssnano. Output to resources/css/bundle*.

Dev-Mode (devbuild) toggles a flag via toggleDevMode(true) — it disables minification and emits source maps.

Build & archive pipeline

flowchart LR
    subgraph B["🔧 npx gulp build"]
        C["🧹 clean<br/>(bundle*)"]
        J["`📜 Rollup<br/>**index-le.js** · le-config.js`"]
        P["🎨 PostCSS<br/>autoprefixer · cssnano"]
        C --> J
        C --> P
    end
    subgraph A["📦 npx gulp archive"]
        A1["build"]
        A2["po2php"]
        A3["`create-archive.sh<br/>**dist/linkenhancer_v<ver>.zip**`"]
        A1 --> A2 --> A3
    end

    classDef bStyle fill:#e3f2fd,stroke:#1565C0,stroke-width:2px
    classDef aStyle fill:#e8f5e9,stroke:#2E7D32,stroke-width:2px

    class C,J,P bStyle
    class A1,A2,A3 aStyle

Translation files

  • updatepo only regenerates the template (messages.pot). The .po files themselves are updated via Weblate, not locally, to avoid conflicts — see the Translation Pipeline page.
  • po2php converts the committed .po files into the PHP arrays webtrees loads at runtime.

3.7 - Translation Pipeline

How translatable strings flow from source to runtime (xgettext → Weblate → PO → PHP)

The module ships its own translations through the standard gettext chain, hosted on Codeberg Weblate.

Flow

flowchart TB
    subgraph Extraction["1️⃣ Code → POT"]
        direction LR
        PHP["📝 src/*.php"] -->|npx gulp updatepo| POT["📄 messages.pot"]
    end

    subgraph Translation["2️⃣ Translation"]
        direction LR
        WEBLATE["🌐 Weblate"] -->|download| PO["🗝 <lang>.po"]
    end

    subgraph Rendering["3️⃣ Webtrees"]
        direction LR
        PHPARR["📦 lang.php"] -->|I18N| RENDER["✅ Render"]
    end

    POT -->|upload| Translation
    PO -->|npx gulp po2php| Rendering

    classDef sourceStyle fill:#e3f2fd,stroke:#1565C0,stroke-width:2px
    classDef fileStyle fill:#e8f5e9,stroke:#2E7D32,stroke-width:2px
    classDef weblateStyle fill:#f3e5f5,stroke:#7B1FA2,stroke-width:2px
    classDef renderStyle fill:#fce4ec,stroke:#C2185B,stroke-width:2px

    class PHP sourceStyle
    class POT,PO,PHPARR fileStyle
    class WEBLATE weblateStyle
    class RENDER renderStyle

Extracting strings

update-po-files.sh runs xgettext over every *.php / *.phtml except util/, vendor/, node_modules/ and tests/:

xgettext -L PHP \
  --keyword=translate --keyword=plural:1,2 --keyword=translateContext:1c,2 \
  --add-comments=I18N --from-code=utf-8 \
  --output=resources/lang/messages.pot …

Two marker helpers control what gets extracted:

  • I18N::translate() / MoreI18N::translate() — module-specific strings. translate is an xgettext keyword, so these are picked up.
  • MoreI18N::xlate() — strings already covered by the webtrees core POT. Same runtime behaviour, different name, therefore invisible to xgettext. After a core update, re-compare messages.pot with the core POT and switch any newly-covered msgid to xlate().

Add /* I18N: … */ comments to give translators context (picked up via --add-comments=I18N).

PO → PHP

.po files are not merged locally — that is Weblate’s job, to prevent conflicts. Once Weblate delivers updated .po files, compile them:

npx gulp po2php

Note: a former .po → .mo step is obsolete (translation format switch, issue #88).

3.8 - WTHB TOC Language Pipeline

How the German webtrees manual TOC is produced (GenWiki → pywikibot → generation → external repo / Pages / Weblate → module)

Overview

The linkenhancer-wthb-toc-lang package delivers the table of contents (TOC) of the German webtrees manual — and its translations — to the WTHB help feature. Its production is a round trip that lives entirely outside the webtrees install: it reads the manual from GenWiki, regenerates the TOC, writes the result back to GenWiki as a MediaWiki template, and — in parallel — ships the structured data to an external Codeberg repo that feeds Codeberg Pages, Weblate (translations) and, finally, the module. This page documents the production side; the consumer side (cache, CLI, rendering) is covered on the WTHB feature page and the CLI scripts page.

Ressources

Pipeline

The round trip has two halves: the GenWiki round trip (read the manual → generate → write the TOC template back) and the delivery pipeline (structured data → external repo → Pages / Weblate → module).

The GenWiki round trip:

flowchart TB
    subgraph HOST["🖥️ Host · gw-skripte/"]
        ORCH["`🚦 **wt-maintain.sh**<br/>*Orchestration*`"]
        PREAD["`🤖 **pywikibot** · *wt-maintain.py*<br/>SectionsExportBot — *READ*`"]
        GEN["`⚙️ **wt-gen-toc.py** *(pandas)*`"]
        PREP["`📄 *pagefromfile file*<br/>vorlage_wt-verzeichnis-toc.txt`"]
        PWRITE["`🤖 **pywikibot** · *pagefromfile*<br/>*WRITE* — Bot-Summary`"]
    end

    GW["`📖 **GenWiki** · wiki.genealogy.net<br/>*webtrees handbook pages*`"]
    CSV["`📄 *3 CSV*<br/>pageinfo · sections · images`"]
    OUT["`📦 *Outputs*<br/>wthb-toc.wiki · .html · .json · de.json`"]
    TPL["`📖 **Vorlage:WT-Verzeichnis-TOC**<br/>*noinclude + includeonly TOC*`"]
    API["`🔍 *API action=parse* → HTML<br/>(curl + jq)`"]

    GW -->|"allpages prefix 'Webtrees Handbuch'<br/>API parse/sections + imagelinks"| PREAD
    ORCH -.->|"drives"| PREAD
    PREAD --> CSV
    CSV -->|"+ wthb-pageinfo_ext.csv (target)"| GEN
    GEN --> OUT
    OUT --> PREP
    PREP --> PWRITE
    PWRITE -->|"pagefromfile -force"| TPL
    TPL -->|"curl API parse"| API

    classDef srcStyle fill:#e3f2fd,stroke:#1565c0,stroke-width:2px
    classDef coreStyle fill:#ede7f6,stroke:#5e35b1,stroke-width:2px
    classDef okStyle fill:#e8f5e9,stroke:#2e7d32,stroke-width:2px
    classDef pwbStyle fill:#fff8e1,stroke:#f57f17,stroke-width:2px
    classDef targetStyle fill:#fce4ec,stroke:#ad1457,stroke-width:2px

    class GW srcStyle
    class ORCH,GEN coreStyle
    class CSV,OUT,API okStyle
    class PREAD,PWRITE pwbStyle
    class TPL targetStyle

Orchestration — wt-maintain.sh

Everything runs from one host script (in gw-skripte/):

wt-maintain.sh <wthb-pageinfo_ext.csv> <DATADIR>

It depends on setenv.sh exporting PWB_PY, PWB_CONF and SCRIPTDIR, and drives these steps in order:

  1. query the GenWiki data (pywikibot READ)
  2. generate the TOC
  3. build the pagefromfile wrapper file
  4. write the template back to GenWiki (pywikibot WRITE)
  5. parse-check the rendered template (curl + jq)
  6. deploy the JSON to the external repo
  7. downstream: repo CI, Weblate and the module pick the data up

GenWiki data query (pywikibot READ)

Step 1 is wt-maintain.py, a pywikibot bot (SectionsExportBot, extending ExistingPageBot). It calls site.login(), iterates allpages(prefix="Webtrees Handbuch") and, per page, queries the MediaWiki API (action=parse&prop=sections) plus imagelinks() (FilePage info).
The result is three CSV files:

  1. wthb-pageinfo.csv,
  2. wthb-sections.csv and
  3. wthb-images.csv.

Two manual follow-ups remain (per the script header): (b) maintaining the image directory and (c) adding the images to the Kategorie:Webtrees category — done by hand (helper: wt-webtrees-cat-files.sh).

TOC generation — wt-gen-toc.py

Step 2 is a pandas script that combines the IST state (the three CSVs) with the SOLL target structure in wthb-pageinfo_ext.csv. classify_prefix() assigns chapter/section prefixes. It writes four outputs:

  • wthb-toc.wiki — the MediaWiki TOC source
  • wthb-toc.json — the structured data the module consumes
  • de.json — the German language file for Weblate
  • wthb-toc.html — a rendered HTML copy (legacy/parallel — the current consumer renders from JSON)

GenWiki template (pywikibot WRITE)

Steps 3–4 wrap the generated TOC in the MediaWiki template Vorlage:WT-Verzeichnis-TOC and write it back:

  • the pagefromfile file combines a <noinclude> part ({{Dokumentation}} + [[Kategorie:Webtrees]]) with an <includeonly> part (Stand: <datum> + <div class="wthbtoc">…</div>).
  • pywikibot pagefromfile -force -pt:1 -summary:"Bot: Webtrees Handbuch Inhaltsverzeichnis aktualisiert" performs the write.

Step 5 verifies the result by parsing it back through the GenWiki API (action=parse&format=json) and extracting the HTML with jq -r '.parse.text["*"]'.

Note: this is automatic writing to GenWiki via pywikibot — the opposite of the “produce review output, no bot” approach used for the GenWiki help-docs export. Vorlage:WT-Verzeichnis-TOC and Kategorie:Webtrees are GenWiki-specific German names and are kept verbatim.

External repo, CI & Pages

The second half of the pipeline (step 6 onward) ships the structured data out of the host:

flowchart TB
    OUT["`📦 *Outputs*<br/>wthb-toc.json + de.json`"]
    DEP["`🚀 **wt-deploy-toc-lang.sh**`"]

    subgraph EXTERNAL["🌐 External infrastructure"]
        REPO["`📦 **linkenhancer-wthb-toc-lang**<br/>(Codeberg)`"]
        META["`🔧 *tools/gen_meta.py*<br/>languages.json + version.json`"]
        CI["`⚙️ *CI regen-meta.yml*<br/>gen_toc_html.py`"]
        PG["`🌐 **Codeberg Pages**`"]
        WLB["`🌐 **Weblate** · linkenhancer/wthb-toc`"]
        TNG["🗝 en.json · fr.json · …"]
    end

    subgraph MODULE["📦 Module (linkenhancer)"]
        SVC["`**WthbTocService**`"]
        DS["`💾 *data/…/wthb-toc-lang/*<br/>2-Layer-Cache`"]
        RDR["`📄 **help-wthb-toc.phtml**<br/>TOC-Modal`"]
    end

    OUT -->|"cp wthb-toc.json + de.json"| DEP
    DEP -->|"git add / commit / push"| REPO
    REPO -->|"regen meta"| META
    REPO --> CI --> PG
    REPO -->|"de.json (Source)"| WLB
    WLB --> TNG
    TNG -->|"[lang].json"| REPO
    PG -->|"fetch JSON"| MODULE
    SVC --> DS --> RDR

    classDef coreStyle fill:#ede7f6,stroke:#5e35b1,stroke-width:2px
    classDef okStyle fill:#e8f5e9,stroke:#2e7d32,stroke-width:2px
    classDef queueStyle fill:#fff3e0,stroke:#e65100,stroke-width:2px

    class OUT okStyle
    class DEP,REPO,META,CI,SVC coreStyle
    class PG,TNG,DS,RDR okStyle
    class WLB queueStyle
  • wt-deploy-toc-lang.sh copies wthb-toc.json and de.json into the linkenhancer-wthb-toc-lang repo, runs tools/gen_meta.py (regenerates languages.json + version.json) and does git add/commit/push. It is standalone-callable and soft-skips (warning + exit 0) when the repo or JSON is missing, so it never aborts the set -e orchestrator.
  • Repo CI (regen-meta.yml) runs gen_toc_html.py and publishes to Codeberg Pages.

Weblate

The repo’s de.json is the source of the Weblate component wt-modules/linkenhancer-wthb-toc; the other [lang].json files are its translation targets. Translations flow back into the repo and are served via Codeberg Pages.

Consumer (module)

Briefly — see the WTHB feature page and the CLI scripts page for details:

Configuration & prerequisites

  • setenv.sh — exports PWB_PY, PWB_CONF, SCRIPTDIR.
  • pywikibot config — user-config-test.py / user-config-prod.py.
  • wthb-toc-lang.env — TOC_LANG_REPO=$HOME/dev/linkenhancer-wthb-toc-lang, TOC_LANG_DATADIR=$HOME/dev/wthb-toc-datadir.
  • Prerequisites: pywikibot, pandas, jq, python3.

Ops & caveats

  • Manual image follow-up — the image directory and Kategorie:Webtrees must be maintained by hand.
  • pagefromfile login — the script comment notes that site.login() may need to be inserted into pagefromfile.py.
  • Soft-skip deploy — a missing repo or JSON is a warning, not a failure (keeps set -e safe).

3.9 - Testing

Test chain: PHP standalone, PHPStan, and JS (Mocha)

The full chain runs with:

npm test

which executes test:php → analyse:php → test:js, each step required to pass before the next runs.

JavaScript (Mocha + jsdom)

npm run test:js
# mocha 'resources/js/tests/**/*.test.js' --require jsdom-global/register

PHP standalone unit tests

npm run test:php
# runs every tests/test-*.php with the system PHP — no webtrees install, no DB
TestCovers
test-text-tag-collector.phptext-tag collector
test-link-classifier.phplink classifier (incl. target extraction)
test-uid-tag-collector.phpUID tag collector
test-uid-index-service.phpUID index service
test-i18n-mark.phpi18n markers
test-wthb-toc-service.phpWTHB TOC service

PHP static analysis

npm run analyse:php      # or: composer analyse
# PHPStan Level 6 — see the PHPStan page

Smoke tests (need webtrees + DB)

These exercise a real installation and are not part of npm test:

php tests/smoke-text-tag-collector.php [limit]
php tests/smoke-migration5.php
php tests/p1-measure.php [--tree=<id>]

3.10 - PHPStan

Static analysis setup and configuration

Required: PHPstan

Static analysis is configured via phpstan.neon (Level 6, baseline in phpstan-baseline.neon).

Run

composer analyse

The analysis requires a webtrees installation (for app/ classes + vendor/autoload.php). Run it from the bind-mounted path:

cd /path/to/webtrees/modules_v4/linkenhancer
composer analyse

Configuration

  • Level: 6
  • Baseline: phpstan-baseline.neon (known issues)
  • Bootstrap: phpstan-bootstrap.php registers PSR-4 namespaces directly (bypasses the version-gated autoloader in wt-shared-libs)
  • Scan directories: ../../app/ (webtrees core classes)
  • Exclude paths: LinkEnhancerModuleExt.php (use in conjunction with Vesta modules)
  • Memory limit: 1G
  • Parallel: disabled (single process, more reliable in CI)

Key settings

  • treatPhpDocTypesAsCertain: false — prevents false positives from @var assertions
  • ignoreErrors for:
    • AccessLevel Enum (WT 2.3-only class, not available in 2.2 runtime)
    • DB::prefix('') — intentional (getting prefix without identifier)

Regenerating the baseline

After intentional changes that introduce new (acceptable) errors:

vendor/bin/phpstan analyse -c phpstan.neon --memory-limit=1G --generate-baseline=phpstan-baseline.neon

Note: Run this via the direct vendor/bin/phpstan call — the composer script wrapper does not forward extra arguments.

3.11 - Releasing

Version bump, build, and release archive creation

Steps

# 1. Bump the version (requires a clean git tree)
npx gulp bumpversion

# 2. Build + compile translations + create the release archive
npx gulp archive

What archive does

npx gulp archive runs build → po2php → create-archive.sh . The script:

  1. Reads the version from latest-version.txt .
  2. rsyncs the module into dist/linkenhancer/, excluding everything that is not shipped (below).
  3. Zips it to dist/linkenhancer_v<version>.zip.

Excluded from the archive

create-archive.sh drops, among others: node_modules/, .git*, gulpfile.mjs, package*.json, phpstan*, tests/, the util/* build scripts, resources/js/src, resources/js/tests, resources/img/, resources/lang/*.po / *.mo, and .env. Only the built bundle* JS/CSS, the compiled resources/lang/*.php, src/, resources/views/, resources/css/ and the module entry files are shipped.

Publishing

  1. Tag the release in git.
  2. Upload dist/linkenhancer_v<version>.zip to a Codeberg / GitHub release with release notes.

The archive is not committed to the repo — it is produced on demand and attached to the release.