Merge remote-tracking branch 'origin/main' into cg14/pr1858
This commit is contained in:
@@ -7,6 +7,11 @@ welcome on [Discord](https://discord.gg/HcTeMZxe5E).
|
||||
This repository holds the game, the launcher and the website, plus the tools, tests and docs that build, check and
|
||||
release them. Anything else (videos, Discord and other community material) lives elsewhere.
|
||||
|
||||
**Where to start: [playhorizon.dev/hub](https://playhorizon.dev/hub).** It shows what is being done now and next
|
||||
([ROADMAP.md](ROADMAP.md) in the repository), the work board, good first tasks, and the forms to report a bug or
|
||||
suggest something. A pull request for a roadmap item carries its `roadmap:<id>` label; ideas go to the suggestion
|
||||
queue (the hub, or `/suggest` on Discord) rather than to issues, which are for bugs.
|
||||
|
||||
## Build it
|
||||
|
||||
You need Rust (stable), Python 3.10+, JDK 25, and on Linux the ALSA and udev headers (`libasound2-dev libudev-dev`).
|
||||
|
||||
@@ -16,6 +16,7 @@
|
||||
<a href="#download"><b>Download</b></a> ·
|
||||
<a href="https://playhorizon.dev/docs/"><b>Documentation</b></a> ·
|
||||
<a href="https://github.com/ludovic111/horizon/releases"><b>Release notes</b></a> ·
|
||||
<a href="ROADMAP.md"><b>Roadmap</b></a> ·
|
||||
<a href="#project-status"><b>Project status</b></a> ·
|
||||
<a href="#contributing"><b>Contributing</b></a>
|
||||
</p>
|
||||
@@ -109,6 +110,10 @@ Everything prepared lands in the gitignored `.local/`. It is derived from the ga
|
||||
|
||||
The client starts on the title screen. Command-line options (`--world`, `--seed`, `--creative`, `--render-distance`, `--dedicated`), controls, scripting through `horizon-ctl` and the architecture are described in [the native client guide](docs/native-client.md). The rest of the developer documentation is indexed in [docs/README.md](docs/README.md), including [the parity workflow](docs/parity-workflow.md).
|
||||
|
||||
## Roadmap
|
||||
|
||||
What is being done now, what comes next and where you can help, in plain words and in technical detail: [ROADMAP.md](ROADMAP.md). [playhorizon.dev/hub](https://playhorizon.dev/hub) shows it with the work board, the journal of what shipped and how to help.
|
||||
|
||||
## Contributing
|
||||
|
||||
Issues and pull requests are welcome: see [CONTRIBUTING.md](CONTRIBUTING.md) for how we work (vanilla first, small pull requests, labels), or [the contributing guide](https://playhorizon.dev/docs/contributing) on the site. Questions and ideas: [Discord](https://discord.gg/HcTeMZxe5E). Before opening a pull request, run the self-check and paste the block it prints:
|
||||
|
||||
+341
@@ -0,0 +1,341 @@
|
||||
# Horizon roadmap
|
||||
|
||||
<!-- Generated by tools/roadmap.py from roadmap/roadmap.toml: edit that file, then run `python3 tools/roadmap.py build`. -->
|
||||
|
||||
What is being done on Horizon, what comes next and where you can help. There are no dates: things are Now, Next or Later. Each item is said in plain words, with the technical picture folded under it. The same roadmap, with a Simple / Technical switch, the board, the journal and how to help, is on [playhorizon.dev/hub](https://playhorizon.dev/hub). Pull requests carry the `roadmap:<id>` label of their item.
|
||||
|
||||
## At a glance
|
||||
|
||||
Horizon is Minecraft: Java Edition 26.3 rewritten from scratch in Rust, so it runs faster on the same computer. Single player, LAN, servers, resource packs and Horizon's own mods work today, on your own copy of the game.
|
||||
|
||||
**Being done now**
|
||||
|
||||
- **Steady frames at long render distances**: Making Horizon faster than vanilla on every computer, with smooth camera movement even at 32 chunks, by spreading the work better over the processor's cores.
|
||||
- **Modpacks' world generation, natively**: Making the world-generation mods of popular modpacks (new structures, YUNG's dungeons and mineshafts, packs built on Lithostitched) generate their worlds in Horizon, natively and fast.
|
||||
- **Playing on servers: everything shows as it should**: When you play on a server, other players, mobs, items and menus look and behave as in vanilla: skins, poses, item names, inventories and server networks.
|
||||
- **Single player as a server: the last differences**: Single player now runs a small server in the background, as vanilla does. We are fixing what still behaves differently there; every fix also works for LAN and server players.
|
||||
- **Horizon's mod registry**: One place for mods, modpacks and resource packs made for Horizon: browse them on the website and install them from the launcher in one click.
|
||||
|
||||
**Next**: Microsoft sign-in (coming soon); CurseForge in the mod browser (coming soon); Fresh benchmarks against vanilla; Pistons push players and mobs; Horizon on Intel Macs.
|
||||
|
||||
**How to help**: Play it and tell us what differs from vanilla (Discord or GitHub), run the benchmark on your computer, vote for what you want next, or pick one of the Help wanted items.
|
||||
|
||||
**Developers**: Read CONTRIBUTING.md, pick a Help wanted item or a To do card, check vanilla's code for the behaviour, and paste the block `python3 tools/pr_ready.py` prints in your pull request.
|
||||
|
||||
## Now
|
||||
|
||||
### Performance
|
||||
|
||||
#### Steady frames at long render distances
|
||||
|
||||
Making Horizon faster than vanilla on every computer, with smooth camera movement even at 32 chunks, by spreading the work better over the processor's cores.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Frame pacing at render distance 32 ([#678](https://github.com/ludovic111/horizon/issues/678)): long frames come from work competing with the render thread. In review: world generation workers build free structure starts instead of queueing them ([#1760](https://github.com/ludovic111/horizon/issues/1760)), the worker pool leaves one core as vanilla does ([#1778](https://github.com/ludovic111/horizon/issues/1778)), and the terrain vertex arena is read as storage where flat draws run ([#1742](https://github.com/ludovic111/horizon/issues/1742)). Still open: far terrain at 48 to 64 chunks ([#718](https://github.com/ludovic111/horizon/issues/718)) and CPU-bound fields of block entities ([#717](https://github.com/ludovic111/horizon/issues/717)). Every change shows before and after numbers from `tools/perf_bench.py` against vanilla 26.3 ([docs/benchmark.md](docs/benchmark.md)).
|
||||
|
||||
</details>
|
||||
|
||||
#### Faster block lookups
|
||||
|
||||
Speeding up the code that reads and writes the blocks of the world, which almost everything in the game goes through: generation, lighting, meshing and ticking.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
`PalettedContainer` and `PackedStorage` find an entry's word by multiply and shift instead of an integer division ([#1790](https://github.com/ludovic111/horizon/issues/1790), [#1794](https://github.com/ludovic111/horizon/issues/1794)); meshing looks up baked models by index, not by name ([#1747](https://github.com/ludovic111/horizon/issues/1747)). Each change keeps the paletted storage harnesses identical and shows its microbenchmark ([docs/performance/paletted-container-access-results.md](docs/performance/paletted-container-access-results.md)).
|
||||
|
||||
</details>
|
||||
|
||||
### Modpacks
|
||||
|
||||
#### Modpacks' world generation, natively
|
||||
|
||||
Making the world-generation mods of popular modpacks (new structures, YUNG's dungeons and mineshafts, packs built on Lithostitched) generate their worlds in Horizon, natively and fast.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
`horizon-port-pack` carries a pack's data-driven content over; structure mods that need code get a native port: YUNG's worldgen as written ([#1746](https://github.com/ludovic111/horizon/issues/1746)), Lithostitched's limited and guaranteed elements with pool and processor modifiers ([#1777](https://github.com/ludovic111/horizon/issues/1777)), its processors as the game's own types ([#1765](https://github.com/ludovic111/horizon/issues/1765)). Proved by the structure blocks and layout harnesses ([#1753](https://github.com/ludovic111/horizon/issues/1753), [#1757](https://github.com/ludovic111/horizon/issues/1757)). Mods whose Java code does more than world generation don't run ([docs/modpacks.md](docs/modpacks.md)).
|
||||
|
||||
</details>
|
||||
|
||||
### Servers and multiplayer
|
||||
|
||||
#### Playing on servers: everything shows as it should
|
||||
|
||||
When you play on a server, other players, mobs, items and menus look and behave as in vanilla: skins, poses, item names, inventories and server networks.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Client-of-a-server fixes in `game/remote*.rs` and `horizon-protocol`: mobs' aggressive and item-use flags ([#1802](https://github.com/ludovic111/horizon/issues/1802), [#1798](https://github.com/ludovic111/horizon/issues/1798)), ghost items after a remote menu ([#1795](https://github.com/ludovic111/horizon/issues/1795)), skins ([#1652](https://github.com/ludovic111/horizon/issues/1652)), cookies and transfer packets for proxy networks ([#1650](https://github.com/ludovic111/horizon/issues/1650)), firework boosts ([#1671](https://github.com/ludovic111/horizon/issues/1671)), living-entity attributes and simulation distance ([#1731](https://github.com/ludovic111/horizon/issues/1731)), styled item names ([#1702](https://github.com/ludovic111/horizon/issues/1702)), primed TNT between updates ([#1710](https://github.com/ludovic111/horizon/issues/1710)).
|
||||
|
||||
</details>
|
||||
|
||||
#### Server dialogs and login screens
|
||||
|
||||
Servers that show dialogs, such as the register and login screens of AuthMe, will work in Horizon.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
26.3's dialog packets and model ([#1720](https://github.com/ludovic111/horizon/issues/1720)), the dialog screen with its buttons and actions ([#1734](https://github.com/ludovic111/horizon/issues/1734)), then text and boolean inputs ([#1735](https://github.com/ludovic111/horizon/issues/1735)).
|
||||
|
||||
</details>
|
||||
|
||||
### Mods and API
|
||||
|
||||
#### Horizon's mod registry
|
||||
|
||||
One place for mods, modpacks and resource packs made for Horizon: browse them on the website and install them from the launcher in one click.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Merged: the registry index (schema 1, `.hpack`, checks before install, [#1634](https://github.com/ludovic111/horizon/issues/1634)), `cargo horizon-mod check` ([#1642](https://github.com/ludovic111/horizon/issues/1642)) and the submission service (`crates/horizon-mod-registry`, [#1659](https://github.com/ludovic111/horizon/issues/1659)). In review: the website's /mods ([#1596](https://github.com/ludovic111/horizon/issues/1596)) and /mods/submit ([#1635](https://github.com/ludovic111/horizon/issues/1635)), and in the launcher the registry as a source ([#1636](https://github.com/ludovic111/horizon/issues/1636)), install, enable and takedowns ([#1637](https://github.com/ludovic111/horizon/issues/1637)), the Mods page ([#1638](https://github.com/ludovic111/horizon/issues/1638)) and modpacks as their own profiles ([#1640](https://github.com/ludovic111/horizon/issues/1640)).
|
||||
|
||||
More: [docs/mods.md](docs/mods.md)
|
||||
|
||||
</details>
|
||||
|
||||
### Gameplay parity
|
||||
|
||||
#### Single player as a server: the last differences
|
||||
|
||||
Single player now runs a small server in the background, as vanilla does. We are fixing what still behaves differently there; every fix also works for LAN and server players.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Since [#1514](https://github.com/ludovic111/horizon/issues/1514) single player runs on the server thread (`game/integrated.rs`) and the window joins it as a client; `--in-frame` keeps the old path. The open `[server-thread]` issues list the gaps. In review: a tool that changes a block ends the click ([#1797](https://github.com/ludovic111/horizon/issues/1797)), potions keep their potion over the connection ([#1796](https://github.com/ludovic111/horizon/issues/1796)), mobs' aggression and arm swings ([#1802](https://github.com/ludovic111/horizon/issues/1802)). [docs/server-levels.md](docs/server-levels.md).
|
||||
|
||||
</details>
|
||||
|
||||
#### Play in your language
|
||||
|
||||
Item names, container titles and server messages follow the language you pick, as in vanilla. Today parts of the game stay in English.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Translatable components resolved through the selected language for items, containers and server text ([#1806](https://github.com/ludovic111/horizon/issues/1806)), on top of the bundled languages the prepared resources carry ([#1594](https://github.com/ludovic111/horizon/issues/1594)). Left: the client's own screens ([#1672](https://github.com/ludovic111/horizon/issues/1672)) and the main menu with zh_cn ([#1774](https://github.com/ludovic111/horizon/issues/1774)).
|
||||
|
||||
</details>
|
||||
|
||||
### Rendering
|
||||
|
||||
#### Shader packs, written again from scratch
|
||||
|
||||
Shader packs were removed and are being rebuilt from scratch. They come back, off by default, once the best-known packs draw properly.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
A clean-room rewrite in `horizon-shaderpack`, from the packs' public format documentation only: reading packs, the preprocessor and `.properties` files are merged ([#1584](https://github.com/ludovic111/horizon/issues/1584), [#1585](https://github.com/ludovic111/horizon/issues/1585), [#1586](https://github.com/ludovic111/horizon/issues/1586)); translating programs to WGSL through naga, buffers, uniforms and the terrain, entity, sky, weather and hand stages are in review ([#1698](https://github.com/ludovic111/horizon/issues/1698) to [#1801](https://github.com/ludovic111/horizon/issues/1801)).
|
||||
|
||||
More: [#1561](https://github.com/ludovic111/horizon/issues/1561) · [#1771](https://github.com/ludovic111/horizon/issues/1771) · [#1786](https://github.com/ludovic111/horizon/issues/1786)
|
||||
|
||||
</details>
|
||||
|
||||
### Horizon extras
|
||||
|
||||
#### Discord Rich Presence
|
||||
|
||||
Your Discord profile can show that you are playing Horizon, with a switch to turn it off.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
A Discord IPC client on its own thread ([#1787](https://github.com/ludovic111/horizon/issues/1787)) and the presence with its setting ([#1788](https://github.com/ludovic111/horizon/issues/1788)). Merged: it ships with the next release.
|
||||
|
||||
</details>
|
||||
|
||||
### Code and tools
|
||||
|
||||
#### A leaner codebase that builds faster
|
||||
|
||||
Cleaning up Horizon's code: removing what nothing uses and making it quicker to build, so fixes and new features land faster.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
A review of the whole tree: dead code and stubs removed ([#1432](https://github.com/ludovic111/horizon/issues/1432), [#1658](https://github.com/ludovic111/horizon/issues/1658)), one probe binary per crate ([#1453](https://github.com/ludovic111/horizon/issues/1453), [#1454](https://github.com/ludovic111/horizon/issues/1454)), shared harness helpers ([#1448](https://github.com/ludovic111/horizon/issues/1448)), clippy clean on the whole tree ([#1707](https://github.com/ludovic111/horizon/issues/1707)). [docs/architecture.md](docs/architecture.md) maps each feature to its files and harnesses.
|
||||
|
||||
</details>
|
||||
|
||||
## Next
|
||||
|
||||
### Performance
|
||||
|
||||
#### Fresh benchmarks against vanilla
|
||||
|
||||
New public numbers comparing Horizon with vanilla on many kinds of computers, measured the same way every time, on the website's Benchmarks page.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Redo the comparison after the current performance work ([#1073](https://github.com/ludovic111/horizon/issues/1073)); reliability, coverage and presentation ([#1346](https://github.com/ludovic111/horizon/issues/1346)); a scene must count as loaded only once its first chunk arrives ([#1749](https://github.com/ludovic111/horizon/issues/1749)). Players' reports come in through `--benchmark` and `horizon-launcher data benchmark` ([docs/benchmark.md](docs/benchmark.md)).
|
||||
|
||||
</details>
|
||||
|
||||
### Modpacks
|
||||
|
||||
#### CurseForge in the mod browser (coming soon)
|
||||
|
||||
Coming soon: search and download CurseForge mods and modpacks from the launcher, as you can with Modrinth today.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
The mod browser lists CurseForge as coming soon ([docs/mod-browser.md](docs/mod-browser.md)): it needs CurseForge API access. Meanwhile packs import from a CurseForge zip or instance folder, and jars only CurseForge hosts come from the player's own instance ([docs/modpacks.md](docs/modpacks.md)).
|
||||
|
||||
</details>
|
||||
|
||||
### Gameplay parity
|
||||
|
||||
#### Pistons push players and mobs
|
||||
|
||||
Pistons and slime blocks will push players, mobs and items as in vanilla. Today moving blocks pass through them.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Port `PistonMovingBlockEntity.moveCollidedEntities` and `moveStuckEntities` (honey), the slime bounce and `Entity.limitPistonMovement` for `MoverType.PISTON`, in single player and for a server's players. Issues [#1496](https://github.com/ludovic111/horizon/issues/1496), [#1609](https://github.com/ludovic111/horizon/issues/1609), [#1608](https://github.com/ludovic111/horizon/issues/1608), [#1704](https://github.com/ludovic111/horizon/issues/1704), [#1758](https://github.com/ludovic111/horizon/issues/1758).
|
||||
|
||||
</details>
|
||||
|
||||
### Launcher
|
||||
|
||||
#### Microsoft sign-in (coming soon)
|
||||
|
||||
Coming soon: sign in with your Microsoft account to play on online-mode servers. The code is ready; it waits for Microsoft's approval.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Device-code sign-in in the launcher and online-mode login in the client ([docs/microsoft-account.md](docs/microsoft-account.md)). It is turned on by setting the app's client id once Minecraft API access is approved; until then the launcher shows "Coming soon".
|
||||
|
||||
More: [#1270](https://github.com/ludovic111/horizon/issues/1270)
|
||||
|
||||
</details>
|
||||
|
||||
#### Horizon on Intel Macs
|
||||
|
||||
Builds of the game and the launcher for Macs with an Intel processor.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
x86_64 game and launcher builds, picked per processor ([#1171](https://github.com/ludovic111/horizon/issues/1171)). Before it ships it needs a run on a real Intel Mac: Rosetta on Apple Silicon only proves the CPU code. Requests: [#1161](https://github.com/ludovic111/horizon/issues/1161), [#1792](https://github.com/ludovic111/horizon/issues/1792).
|
||||
|
||||
</details>
|
||||
|
||||
## Later
|
||||
|
||||
### Gameplay parity
|
||||
|
||||
#### Following new Minecraft versions
|
||||
|
||||
When Mojang releases a new version of the game, Horizon follows it, and every system is checked against the new version again.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
The port pipeline detects a release, diffs its classes against 26.3 and writes a port report ([docs/version-ports.md](docs/version-ports.md)); the harnesses then run against the new version.
|
||||
|
||||
</details>
|
||||
|
||||
### Horizon extras
|
||||
|
||||
#### An optional AI teammate
|
||||
|
||||
An AI teammate that plays beside you and that you can talk to. It is off unless you turn it on, and the No AI switch hides it completely.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Draft pull requests: the companion ([#1068](https://github.com/ludovic111/horizon/issues/1068)), its safety modes and their evaluation ([#1069](https://github.com/ludovic111/horizon/issues/1069)), and a route that finishes the game ([#1070](https://github.com/ludovic111/horizon/issues/1070)). Local models first; it ships only once the safety evaluation passes.
|
||||
|
||||
</details>
|
||||
|
||||
## Help wanted
|
||||
|
||||
### Performance
|
||||
|
||||
#### Benchmark your computer
|
||||
|
||||
Run Horizon's built-in benchmark and share the report: every new computer makes the performance work more accurate. No coding needed.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
`horizon-launcher play --arg=--benchmark --arg=standard` writes a JSON report; `horizon-launcher data benchmark <report>` shows what would be sent and uploads it ([website/docs/performance.md](website/docs/performance.md)). Results from three installs with the same hardware appear on the Benchmarks page. Example: [#1711](https://github.com/ludovic111/horizon/issues/1711).
|
||||
|
||||
</details>
|
||||
|
||||
### Gameplay parity
|
||||
|
||||
#### End city banners keep their pattern
|
||||
|
||||
Banners in End cities show as plain magenta instead of with their pattern.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Compare the banner block entities the End city templates place with vanilla's (`EndCityPieces`, the templates' block entity NBT, `BannerBlockEntity`'s patterns), in `crates/horizon-world/src/worldgen/structure/`. Issue [#1438](https://github.com/ludovic111/horizon/issues/1438); possibly related: [#526](https://github.com/ludovic111/horizon/issues/526).
|
||||
|
||||
</details>
|
||||
|
||||
#### Enchanted loot in End cities
|
||||
|
||||
Armour and tools in End city chests should come enchanted, as in vanilla.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
`loot.rs` implements `enchant_with_levels`: find why the End city chest table's rolls come out bare, and compare them with vanilla's for a few seeds. Issues [#1437](https://github.com/ludovic111/horizon/issues/1437), [#1660](https://github.com/ludovic111/horizon/issues/1660).
|
||||
|
||||
</details>
|
||||
|
||||
#### Cooldowns drawn on items
|
||||
|
||||
After you throw an ender pearl, its slot should show the cooldown sweeping away, as in vanilla.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Vanilla draws `ItemCooldowns`' percent as a white overlay over the slot (`GuiGraphicsExtractor.itemDecorations` and `itemCooldown`) in the hotbar and in inventories. Issue [#1763](https://github.com/ludovic111/horizon/issues/1763).
|
||||
|
||||
</details>
|
||||
|
||||
#### Chat settings and team prefixes
|
||||
|
||||
The Hidden and Commands Only chat settings should hide chat, and team prefixes should appear before names in chat.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Vanilla checks `ChatVisiblity` before it delivers chat and system messages ([#1376](https://github.com/ludovic111/horizon/issues/1376)), and chat uses the team-formatted display name ([#1378](https://github.com/ludovic111/horizon/issues/1378)). Both issues have exact steps to reproduce.
|
||||
|
||||
</details>
|
||||
|
||||
#### A pointing hand over buttons
|
||||
|
||||
The mouse pointer should turn into a pointing hand over menu buttons, as in vanilla 26.3.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
26.3's `AbstractWidget` asks for a cursor from `CursorTypes` when it is hovered; winit's `CursorIcon::Pointer` gives the same shape. Issue [#1347](https://github.com/ludovic111/horizon/issues/1347).
|
||||
|
||||
</details>
|
||||
|
||||
#### Ctrl+Backspace and scroll bars in menus
|
||||
|
||||
Ctrl+Backspace should delete a whole word in the creative search, and every list's scroll bar should be draggable.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
`EditBox` deletes by word with Ctrl ([#1764](https://github.com/ludovic111/horizon/issues/1764)); the Game Rules and Statistics lists' scroll bars can't be dragged ([#1782](https://github.com/ludovic111/horizon/issues/1782), after [#978](https://github.com/ludovic111/horizon/issues/978)).
|
||||
|
||||
</details>
|
||||
|
||||
#### Chickens flap while they fall
|
||||
|
||||
Chickens should flap their wings while they fall, not stand still in the air.
|
||||
|
||||
<details><summary>Technical</summary>
|
||||
|
||||
Vanilla's `Chicken.aiStep` updates `flap` and `flapSpeed` when the chicken isn't on the ground, and the model's wings follow them. Issue [#1706](https://github.com/ludovic111/horizon/issues/1706).
|
||||
|
||||
</details>
|
||||
|
||||
## Recently shipped
|
||||
|
||||
- **Server resource packs** (v0.2.48): Servers can send you their resource pack: Horizon asks, downloads it and applies it, like vanilla. [#1562](https://github.com/ludovic111/horizon/issues/1562) · [#1569](https://github.com/ludovic111/horizon/issues/1569) · [#1570](https://github.com/ludovic111/horizon/issues/1570)
|
||||
- **Single player on its own server thread** (v0.2.39): Single player runs on a server thread, as vanilla does, so the world keeps ticking smoothly while the window draws. [#1514](https://github.com/ludovic111/horizon/issues/1514) · [docs/server-levels.md](docs/server-levels.md)
|
||||
- **GPU occlusion culling on Macs** (v0.2.17): On Macs the GPU now skips terrain hidden behind hills and caves: 8 to 48% more frames per second at 32 chunks on an M4 Pro. [#1434](https://github.com/ludovic111/horizon/issues/1434)
|
||||
- **Animated textures on the GPU** (v0.2.5): Water, lava and other animated blocks are now animated by the graphics card: 1.7 to 2.4 times better 1% lows on Intel graphics. [#1239](https://github.com/ludovic111/horizon/issues/1239)
|
||||
- **Far Detail for integrated graphics** (v0.2.5): An optional Reduced setting for far terrain, suggested on integrated graphics, that saves 2 to 4 ms of GPU time per frame. [#1199](https://github.com/ludovic111/horizon/issues/1199) · [#1029](https://github.com/ludovic111/horizon/issues/1029)
|
||||
- **The launcher's mod browser** (launcher@0.2.0): Search Modrinth for mods, modpacks and resource packs from the launcher; it says before installing what works in Horizon. [#1154](https://github.com/ludovic111/horizon/issues/1154) · [#1242](https://github.com/ludovic111/horizon/issues/1242) · [#1243](https://github.com/ludovic111/horizon/issues/1243) · [#1246](https://github.com/ludovic111/horizon/issues/1246) · [docs/mod-browser.md](docs/mod-browser.md)
|
||||
- **A blocky, Minecraft-like launcher** (launcher@0.2.0): The launcher got a new blocky look in Horizon's purple, in dark and light. [#1269](https://github.com/ludovic111/horizon/issues/1269) · [docs/design-system.md](docs/design-system.md)
|
||||
- **Dynamic lights** (v2026.10.22): An optional extra: torches you hold, drop or set on fire light up what is around them. [#1162](https://github.com/ludovic111/horizon/issues/1162)
|
||||
- **Host a server from the launcher** (launcher-v0.15.0): The launcher's Servers page creates, starts, backs up and updates a Horizon server with buttons, and invites friends. [#1026](https://github.com/ludovic111/horizon/issues/1026) · [docs/hosting.md](docs/hosting.md)
|
||||
@@ -21,6 +21,8 @@ pub struct Report {
|
||||
pub sha256: String,
|
||||
pub size: u64,
|
||||
pub signed: bool,
|
||||
/// A mod has code to run (a content mod may have none).
|
||||
pub code: bool,
|
||||
/// A mod's component imports.
|
||||
pub imports: Vec<String>,
|
||||
/// A mod's commands, each run once.
|
||||
@@ -49,6 +51,7 @@ impl Report {
|
||||
"sha256": self.sha256,
|
||||
"size": self.size,
|
||||
"signed": self.signed,
|
||||
"code": self.code,
|
||||
"imports": self.imports,
|
||||
"commands": self.commands,
|
||||
"output": self.output,
|
||||
@@ -87,7 +90,9 @@ impl Report {
|
||||
for r in &f.requires {
|
||||
out += &format!(" needs {} {} ({})\n", r.id, r.version, &r.sha256[..12]);
|
||||
}
|
||||
if self.kind == Kind::Mod {
|
||||
if self.kind == Kind::Mod && !self.code {
|
||||
out += " no code: content only, nothing to run\n";
|
||||
} else if self.kind == Kind::Mod {
|
||||
let commands = if self.commands.is_empty() {
|
||||
String::new()
|
||||
} else {
|
||||
@@ -142,6 +147,7 @@ pub fn check(
|
||||
sha256: index::sha256_file(path)?,
|
||||
size,
|
||||
signed,
|
||||
code: false,
|
||||
imports: Vec::new(),
|
||||
commands: Vec::new(),
|
||||
output: Vec::new(),
|
||||
@@ -153,10 +159,14 @@ pub fn check(
|
||||
}
|
||||
|
||||
/// Runs a mod in the sandbox, as the game does, from a scratch copy so its
|
||||
/// storage lands in a folder removed afterwards.
|
||||
/// storage lands in a folder removed afterwards. A content mod has no code to
|
||||
/// run: `inspect` already read its content as the game does.
|
||||
fn trial_run(path: &Path, report: &mut Report) -> Result<(), String> {
|
||||
let package = Package::read(path)?;
|
||||
let wasm = package.wasm.as_deref().ok_or("the .hmod has no mod.wasm")?;
|
||||
let Some(wasm) = package.wasm.as_deref() else {
|
||||
return Ok(());
|
||||
};
|
||||
report.code = true;
|
||||
report.imports = component_imports(wasm)?;
|
||||
package
|
||||
.manifest
|
||||
|
||||
@@ -1,14 +1,16 @@
|
||||
//! `cargo horizon-mod`: make Horizon mods in Rust (`docs/mods.md`).
|
||||
//!
|
||||
//! - `new <path> [--name "Name"] [--sdk-path <dir>]`: a mod crate from the template.
|
||||
//! - `build [--debug]`: the `.hmod` in `target/horizon-mod/`.
|
||||
//! - `new <path> [--template code|content] [--name "Name"] [--sdk-path <dir>]`:
|
||||
//! a mod from a template: a Rust crate, or a content mod (no code).
|
||||
//! - `build [--debug]`: the `.hmod` in `target/horizon-mod/`, with the mod's
|
||||
//! `assets/` and `data/`; a folder without `Cargo.toml` is content only.
|
||||
//! - `run [--game <horizon-client>] [-- <game args>]`: build, then play with
|
||||
//! the mod; run `build` again and the game reloads it.
|
||||
//! - `check <file> [--json]`: what the registry checks of a submission
|
||||
//! (`.hmod`, `.hpack`, resource pack `.zip`), with a trial run for a mod.
|
||||
//! - `registry build|review|check|list`: the registry repository's CI.
|
||||
use horizon_mods::{
|
||||
Manifest, Package,
|
||||
Capability, Content, Manifest, Package,
|
||||
manifest::{MANIFEST, component_imports, componentize},
|
||||
};
|
||||
mod check;
|
||||
@@ -36,7 +38,7 @@ fn main() -> ExitCode {
|
||||
Some("run") => run(&args[1..]),
|
||||
Some("check") => check(&args[1..]),
|
||||
Some("registry") => registry::main(&args[1..]),
|
||||
_ => Err("usage: cargo horizon-mod new <path> | build [--debug] | run [--game <horizon-client>] [-- <game args>] | check <file> [--kind <kind>] [--key <public key> --signature <file.minisig>] [--json] | registry build|review|check|list".into()),
|
||||
_ => Err("usage: cargo horizon-mod new <path> [--template code|content] | build [--debug] | run [--game <horizon-client>] [-- <game args>] | check <file> [--kind <kind>] [--key <public key> --signature <file.minisig>] [--json] | registry build|review|check|list".into()),
|
||||
};
|
||||
match result {
|
||||
Ok(()) => ExitCode::SUCCESS,
|
||||
@@ -90,19 +92,68 @@ fn new(args: &[String]) -> Result<(), String> {
|
||||
.replace("{name}", &name)
|
||||
.replace("{sdk}", &sdk)
|
||||
};
|
||||
let files = [
|
||||
let code = [
|
||||
("Cargo.toml", include_str!("../template/Cargo.toml.in")),
|
||||
(MANIFEST, include_str!("../template/horizon-mod.toml")),
|
||||
("src/lib.rs", include_str!("../template/src/lib.rs")),
|
||||
(".gitignore", include_str!("../template/gitignore")),
|
||||
];
|
||||
for (file, text) in files {
|
||||
// A block copying a vanilla one, with its model, name, loot, recipe and tag.
|
||||
let content = [
|
||||
(
|
||||
MANIFEST,
|
||||
include_str!("../template/content/horizon-mod.toml"),
|
||||
),
|
||||
(
|
||||
"data/{id}/horizon/block/glowing_amethyst.json",
|
||||
include_str!("../template/content/block.json"),
|
||||
),
|
||||
(
|
||||
"assets/{id}/blockstates/glowing_amethyst.json",
|
||||
include_str!("../template/content/blockstate.json"),
|
||||
),
|
||||
(
|
||||
"assets/{id}/models/block/glowing_amethyst.json",
|
||||
include_str!("../template/content/model.json"),
|
||||
),
|
||||
(
|
||||
"assets/{id}/items/glowing_amethyst.json",
|
||||
include_str!("../template/content/item.json"),
|
||||
),
|
||||
(
|
||||
"assets/{id}/lang/en_us.json",
|
||||
include_str!("../template/content/lang.json"),
|
||||
),
|
||||
(
|
||||
"data/{id}/loot_table/blocks/glowing_amethyst.json",
|
||||
include_str!("../template/content/loot.json"),
|
||||
),
|
||||
(
|
||||
"data/{id}/recipe/glowing_amethyst.json",
|
||||
include_str!("../template/content/recipe.json"),
|
||||
),
|
||||
(
|
||||
"data/minecraft/tags/block/mineable/pickaxe.json",
|
||||
include_str!("../template/content/pickaxe.json"),
|
||||
),
|
||||
(".gitignore", include_str!("../template/gitignore")),
|
||||
];
|
||||
let files: &[(&str, &str)] = match flag(args, "--template").unwrap_or("code") {
|
||||
"code" => &code,
|
||||
"content" => &content,
|
||||
other => return Err(format!("no template {other}: code or content")),
|
||||
};
|
||||
for &(file, text) in files {
|
||||
let file = fill(file);
|
||||
let file = file.as_str();
|
||||
let to = dir.join(file);
|
||||
std::fs::create_dir_all(to.parent().expect("a file in the mod"))
|
||||
.map_err(|e| e.to_string())?;
|
||||
std::fs::write(&to, fill(text)).map_err(|e| format!("{}: {e}", to.display()))?;
|
||||
}
|
||||
Manifest::parse(&std::fs::read_to_string(dir.join(MANIFEST)).map_err(|e| e.to_string())?)?;
|
||||
let manifest =
|
||||
Manifest::parse(&std::fs::read_to_string(dir.join(MANIFEST)).map_err(|e| e.to_string())?)?;
|
||||
Content::read(dir, &manifest)?;
|
||||
println!(
|
||||
"Created {} (mod id {id}). Next: cd {path} && cargo horizon-mod run",
|
||||
dir.display()
|
||||
@@ -110,14 +161,53 @@ fn new(args: &[String]) -> Result<(), String> {
|
||||
Ok(())
|
||||
}
|
||||
|
||||
/// Builds the crate in the current folder and packs `target/horizon-mod/<id>.hmod`.
|
||||
/// Builds the mod in the current folder and packs `target/horizon-mod/<id>.hmod`:
|
||||
/// the manifest, the crate's component (none without a `Cargo.toml`: a
|
||||
/// content mod) and the files in `assets/` and `data/`.
|
||||
fn build(release: bool) -> Result<PathBuf, String> {
|
||||
let manifest_text = std::fs::read_to_string(MANIFEST)
|
||||
build_in(Path::new("."), release)
|
||||
}
|
||||
|
||||
fn build_in(root: &Path, release: bool) -> Result<PathBuf, String> {
|
||||
let manifest_text = std::fs::read_to_string(root.join(MANIFEST))
|
||||
.map_err(|e| format!("{MANIFEST}: {e} (run this in a mod's folder)"))?;
|
||||
let manifest = Manifest::parse(&manifest_text)?;
|
||||
let (wasm, target_dir) = if root.join("Cargo.toml").exists() {
|
||||
let (wasm, target) = compile(root, release)?;
|
||||
// The game refuses a component importing capabilities the manifest lacks.
|
||||
manifest.check_imports(component_imports(&wasm)?.iter().map(String::as_str))?;
|
||||
(Some(wasm), target)
|
||||
} else if manifest.capabilities.contains(&Capability::Registries) {
|
||||
(None, root.join("target"))
|
||||
} else {
|
||||
return Err(format!(
|
||||
"no Cargo.toml: only a content mod (capability registries in {MANIFEST}) has no code"
|
||||
));
|
||||
};
|
||||
// The same checks as the game's, and the files in the order it lists them.
|
||||
let content = Content::read(root, &manifest)?;
|
||||
let mut reader = content.reader()?;
|
||||
let mut files = Vec::with_capacity(content.files.len());
|
||||
for name in &content.files {
|
||||
files.push((name.as_str(), reader.read(name)?));
|
||||
}
|
||||
let files: Vec<(&str, &[u8])> = files.iter().map(|(n, b)| (*n, b.as_slice())).collect();
|
||||
let dir = target_dir.join("horizon-mod");
|
||||
std::fs::create_dir_all(&dir).map_err(|e| e.to_string())?;
|
||||
let path = dir.join(format!("{}.hmod", manifest.id));
|
||||
// Write then rename, so a running game never reads half a file.
|
||||
let partial = path.with_extension("hmod.partial");
|
||||
let bytes = Package::write_files(&manifest_text, wasm.as_deref(), &files)?;
|
||||
std::fs::write(&partial, bytes).map_err(|e| e.to_string())?;
|
||||
std::fs::rename(&partial, &path).map_err(|e| e.to_string())?;
|
||||
Ok(path)
|
||||
}
|
||||
|
||||
/// Builds the crate for WebAssembly: its component, and Cargo's target folder.
|
||||
fn compile(root: &Path, release: bool) -> Result<(Vec<u8>, PathBuf), String> {
|
||||
let cargo = std::env::var("CARGO").unwrap_or_else(|_| "cargo".into());
|
||||
let mut cmd = Command::new(cargo);
|
||||
cmd.args([
|
||||
cmd.current_dir(root).args([
|
||||
"build",
|
||||
"--lib",
|
||||
"--target",
|
||||
@@ -145,17 +235,8 @@ fn build(release: bool) -> Result<PathBuf, String> {
|
||||
.rfind(|f| f.extension().is_some_and(|e| e == "wasm"))
|
||||
.ok_or("the build made no .wasm: is the crate a cdylib?")?;
|
||||
let wasm = componentize(&std::fs::read(&core).map_err(|e| e.to_string())?)?;
|
||||
// The game refuses a component importing capabilities the manifest lacks.
|
||||
manifest.check_imports(component_imports(&wasm)?.iter().map(String::as_str))?;
|
||||
let target_dir = core.ancestors().nth(3).ok_or("unexpected target folder")?;
|
||||
let dir = target_dir.join("horizon-mod");
|
||||
std::fs::create_dir_all(&dir).map_err(|e| e.to_string())?;
|
||||
let path = dir.join(format!("{}.hmod", manifest.id));
|
||||
// Write then rename, so a running game never reads half a file.
|
||||
let partial = path.with_extension("hmod.partial");
|
||||
std::fs::write(&partial, Package::write(&manifest_text, &wasm)?).map_err(|e| e.to_string())?;
|
||||
std::fs::rename(&partial, &path).map_err(|e| e.to_string())?;
|
||||
Ok(path)
|
||||
let target = core.ancestors().nth(3).ok_or("unexpected target folder")?;
|
||||
Ok((wasm, target.to_path_buf()))
|
||||
}
|
||||
|
||||
/// `check <file>`: the registry's checks of a submission, printed; fails
|
||||
@@ -237,4 +318,49 @@ mod tests {
|
||||
);
|
||||
std::fs::remove_dir_all(&dir).unwrap();
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn the_content_template_builds_and_checks_with_no_code() {
|
||||
let dir = std::env::temp_dir().join(format!("horizon-mod-content-{}", std::process::id()));
|
||||
let path = dir.join("gems");
|
||||
let new_args = [
|
||||
path.display().to_string(),
|
||||
"--template".into(),
|
||||
"content".into(),
|
||||
];
|
||||
new(&new_args).unwrap();
|
||||
assert!(!path.join("Cargo.toml").exists());
|
||||
let hmod = build_in(&path, true).unwrap();
|
||||
assert_eq!(hmod, path.join("target/horizon-mod/gems.hmod"));
|
||||
let package = Package::read(&hmod).unwrap();
|
||||
assert!(package.wasm.is_none());
|
||||
let content = Content::read(&hmod, &package.manifest).unwrap();
|
||||
assert!(
|
||||
content
|
||||
.files
|
||||
.contains(&"data/gems/horizon/block/glowing_amethyst.json".into())
|
||||
);
|
||||
assert_eq!(content.files.len(), 8, "{:?}", content.files);
|
||||
let report = check::check(&hmod, check::kind_of(&hmod).unwrap(), None, None).unwrap();
|
||||
assert!(!report.code);
|
||||
assert!(
|
||||
report.text().contains("no code: content only"),
|
||||
"{}",
|
||||
report.text()
|
||||
);
|
||||
// Without registries, a mod needs code.
|
||||
let manifest = std::fs::read_to_string(path.join(MANIFEST)).unwrap();
|
||||
let manifest = manifest.replace("[\"registries\"]", "[]");
|
||||
std::fs::write(path.join(MANIFEST), manifest).unwrap();
|
||||
assert!(build_in(&path, true).unwrap_err().contains("no Cargo.toml"));
|
||||
assert!(
|
||||
new(&[
|
||||
dir.join("x").display().to_string(),
|
||||
"--template".into(),
|
||||
"lua".into()
|
||||
])
|
||||
.is_err()
|
||||
);
|
||||
std::fs::remove_dir_all(&dir).unwrap();
|
||||
}
|
||||
}
|
||||
|
||||
@@ -0,0 +1,4 @@
|
||||
{
|
||||
"template": "minecraft:amethyst_block",
|
||||
"properties": { "hardness": 2.0, "light": 7 }
|
||||
}
|
||||
@@ -0,0 +1,5 @@
|
||||
{
|
||||
"variants": {
|
||||
"": { "model": "{id}:block/glowing_amethyst" }
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,10 @@
|
||||
id = "{id}"
|
||||
name = "{name}"
|
||||
version = "0.1.0"
|
||||
description = ""
|
||||
authors = []
|
||||
# A content mod: blocks and items from data/ and assets/, no code (API 0.2).
|
||||
api = "0.2"
|
||||
side = "both"
|
||||
# registries: "May add blocks and items to your worlds".
|
||||
capabilities = ["registries"]
|
||||
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"model": { "type": "minecraft:model", "model": "{id}:block/glowing_amethyst" }
|
||||
}
|
||||
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"block.{id}.glowing_amethyst": "Glowing Amethyst"
|
||||
}
|
||||
@@ -0,0 +1,11 @@
|
||||
{
|
||||
"type": "minecraft:block",
|
||||
"pools": [
|
||||
{
|
||||
"condition": { "type": "minecraft:survives_explosion" },
|
||||
"entries": [{ "type": "minecraft:item", "name": "{id}:glowing_amethyst" }],
|
||||
"rolls": 1
|
||||
}
|
||||
],
|
||||
"random_sequence": "{id}:blocks/glowing_amethyst"
|
||||
}
|
||||
@@ -0,0 +1,4 @@
|
||||
{
|
||||
"parent": "minecraft:block/cube_all",
|
||||
"textures": { "all": "minecraft:block/amethyst_block" }
|
||||
}
|
||||
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"values": ["{id}:glowing_amethyst"]
|
||||
}
|
||||
@@ -0,0 +1,6 @@
|
||||
{
|
||||
"type": "minecraft:crafting_shapeless",
|
||||
"category": "building",
|
||||
"ingredients": ["minecraft:amethyst_block", "minecraft:glowstone_dust"],
|
||||
"result": { "id": "{id}:glowing_amethyst" }
|
||||
}
|
||||
@@ -12101,6 +12101,8 @@ enum PendingWorldEntry {
|
||||
Server {
|
||||
address: String,
|
||||
name: String,
|
||||
/// A transfer's carried-over server cookies (`TransferState`).
|
||||
cookies: Option<horizon_client::net::Cookies>,
|
||||
},
|
||||
}
|
||||
|
||||
@@ -12175,8 +12177,12 @@ impl Game<'_> {
|
||||
}) => {
|
||||
self.open_world(&folder, name.as_deref(), seed, creative, create.as_deref())?;
|
||||
}
|
||||
Some(PendingWorldEntry::Server { address, name }) => {
|
||||
self.connect_server(&address, &name)?;
|
||||
Some(PendingWorldEntry::Server {
|
||||
address,
|
||||
name,
|
||||
cookies,
|
||||
}) => {
|
||||
self.connect_server_with_cookies(&address, &name, cookies)?;
|
||||
}
|
||||
None => {}
|
||||
}
|
||||
|
||||
@@ -469,7 +469,8 @@ impl Game<'_> {
|
||||
"flying": p.flying,
|
||||
"fall_flying": p.fall_flying,
|
||||
"sneaking": self.keys.contains(&KeyCode::ShiftLeft),
|
||||
"sprinting": self.keys.contains(&KeyCode::ControlLeft),
|
||||
"sprinting": p.sprinting,
|
||||
"fov_modifier": self.view.fov_modifier,
|
||||
"health": p.health.health(),
|
||||
"absorption": p.health.absorption(),
|
||||
// The hurt animation's ticks left (the camera's hurt tilt).
|
||||
|
||||
@@ -193,6 +193,9 @@ pub(super) struct Remote {
|
||||
/// the oldest of them first waited (`poll_remote`).
|
||||
backlog: VecDeque<Event>,
|
||||
backlog_since: Option<Instant>,
|
||||
/// `ClientboundTransferPacket`'s target: when the connection ends the
|
||||
/// game connects here, the stored cookies carried over (`TransferState`).
|
||||
transfer: Option<String>,
|
||||
}
|
||||
|
||||
/// The time a frame spends on chunk packets before it leaves the rest of
|
||||
@@ -257,14 +260,25 @@ fn number_format(f: &play::NumberFormat) -> horizon_client::scoreboard::NumberFo
|
||||
impl Game<'_> {
|
||||
/// Leave the title for a server (ConnectScreen): an empty world fed by the connection.
|
||||
pub(super) fn connect_server(&mut self, address: &str, name: &str) -> Result<()> {
|
||||
self.connect_server_with_cookies(address, name, None)
|
||||
}
|
||||
/// `connect_server` carrying a transfer's stored server cookies
|
||||
/// (`TransferState`); None on an ordinary join.
|
||||
pub(super) fn connect_server_with_cookies(
|
||||
&mut self,
|
||||
address: &str,
|
||||
name: &str,
|
||||
cookies: Option<horizon_client::net::Cookies>,
|
||||
) -> Result<()> {
|
||||
if self.defer_world_entry(super::PendingWorldEntry::Server {
|
||||
address: address.to_owned(),
|
||||
name: name.to_owned(),
|
||||
cookies: cookies.clone(),
|
||||
})? {
|
||||
return Ok(());
|
||||
}
|
||||
self.join_world_rest()?;
|
||||
if let Err(error) = self.join_server(address, name, None) {
|
||||
if let Err(error) = self.join_server(address, name, None, cookies) {
|
||||
log::warn!("Horizon: could not join server: {error}");
|
||||
if self.title.is_none() {
|
||||
self.title = Some(horizon_client::title::Title::new(
|
||||
@@ -285,13 +299,14 @@ impl Game<'_> {
|
||||
pipe: horizon_protocol::connection::Pipe,
|
||||
name: &str,
|
||||
) -> Result<()> {
|
||||
self.join_server("local", name, Some(pipe))
|
||||
self.join_server("local", name, Some(pipe), None)
|
||||
}
|
||||
fn join_server(
|
||||
&mut self,
|
||||
address: &str,
|
||||
name: &str,
|
||||
local: Option<horizon_protocol::connection::Pipe>,
|
||||
cookies: Option<horizon_client::net::Cookies>,
|
||||
) -> Result<()> {
|
||||
self.perf.world_opening();
|
||||
let root = self.options.resources.clone();
|
||||
@@ -323,7 +338,17 @@ impl Game<'_> {
|
||||
Some(pipe) => Session::connect_local(pipe, name, view, lang.clone()),
|
||||
None => {
|
||||
self.extras_connecting(address, name);
|
||||
Session::connect(address, name, auth.clone(), view, lang.clone())
|
||||
match cookies {
|
||||
Some(cookies) => Session::connect_transferred(
|
||||
address,
|
||||
name,
|
||||
auth.clone(),
|
||||
view,
|
||||
lang.clone(),
|
||||
cookies,
|
||||
),
|
||||
None => Session::connect(address, name, auth.clone(), view, lang.clone()),
|
||||
}
|
||||
}
|
||||
};
|
||||
let player_type = super::perspective::player_type(&root);
|
||||
@@ -446,6 +471,7 @@ impl Game<'_> {
|
||||
chunk_center: (0, 0),
|
||||
backlog: VecDeque::new(),
|
||||
backlog_since: None,
|
||||
transfer: None,
|
||||
});
|
||||
// The level's TickRateManager follows the server's ticking packets.
|
||||
self.clock = horizon_client::clock::FixedStep::client();
|
||||
@@ -867,6 +893,15 @@ impl Game<'_> {
|
||||
}
|
||||
}
|
||||
Event::Reconfigured(registries) => self.set_registries(registries),
|
||||
// handleTransfer: "Cannot transfer to server from
|
||||
// singleplayer" (no ServerData), so the world just closes.
|
||||
Event::Transfer { host, port } => {
|
||||
if let Some(r) = self.remote.as_mut()
|
||||
&& r.session.address != "local"
|
||||
{
|
||||
r.transfer = Some(format!("{host}:{port}"));
|
||||
}
|
||||
}
|
||||
Event::PackPush(p) => self.handle_pack_push(p),
|
||||
Event::PackPop(id) => self.handle_pack_pop(id),
|
||||
Event::DecodeError(e) => {
|
||||
@@ -882,6 +917,20 @@ impl Game<'_> {
|
||||
from_server,
|
||||
} => {
|
||||
log::info!("Horizon: disconnected: {reason}");
|
||||
// ClientboundTransferPacket left a target: connect there
|
||||
// instead of showing the disconnect, the stored cookies
|
||||
// carried over (ClientCommonPacketListenerImpl.
|
||||
// handleTransfer → ConnectScreen.startConnecting).
|
||||
let transfer = self.remote.as_mut().and_then(|r| {
|
||||
r.transfer.take().map(|address| {
|
||||
(address, r.session.name.clone(), r.session.cookies.clone())
|
||||
})
|
||||
});
|
||||
if let Some((address, name, cookies)) = transfer {
|
||||
self.leave_server(None)?;
|
||||
self.connect_server_with_cookies(&address, &name, Some(cookies))?;
|
||||
return Ok(());
|
||||
}
|
||||
let retry = self.reconnect_after(&reason, from_server);
|
||||
self.leave_server(Some(reason))?;
|
||||
self.offer_reconnect(retry);
|
||||
@@ -1015,6 +1064,9 @@ impl Game<'_> {
|
||||
r.stepped.clear();
|
||||
r.head_lerps.clear();
|
||||
r.pending_items.clear();
|
||||
// The entity ids are the old world's; the new dimension's
|
||||
// player entities re-map to their profiles on AddEntity.
|
||||
r.level_players.clear();
|
||||
// A new ClientLevel: a new chunk storage, centred on 0, 0.
|
||||
r.chunk_center = (0, 0);
|
||||
}
|
||||
@@ -4794,6 +4846,11 @@ impl Game<'_> {
|
||||
self.mount_menu_reset();
|
||||
// The client's menu has no level access: what it holds is the server's.
|
||||
self.station = None;
|
||||
// AbstractContainerMenu.removed: the server gives the grid and the
|
||||
// carried stack back to the inventory and syncs it; the copies here
|
||||
// are stale the moment the window closes.
|
||||
self.craft_grid.fill(None);
|
||||
self.carried = None;
|
||||
self.craft_size = 2;
|
||||
if let Some(key) = self.container.take() {
|
||||
// Server containers stay renderable but lose their copied slots.
|
||||
|
||||
@@ -33,6 +33,7 @@ impl StartupMenu {
|
||||
Some(PendingWorldEntry::Server {
|
||||
address: address.clone(),
|
||||
name: options.player_name(),
|
||||
cookies: None,
|
||||
})
|
||||
} else {
|
||||
options
|
||||
@@ -125,6 +126,7 @@ impl StartupMenu {
|
||||
Action::Connect { address } => PendingWorldEntry::Server {
|
||||
address,
|
||||
name: player_name,
|
||||
cookies: None,
|
||||
},
|
||||
_ => return,
|
||||
};
|
||||
@@ -762,7 +764,7 @@ mod tests {
|
||||
"Guest".into(),
|
||||
);
|
||||
assert!(
|
||||
matches!(menu.pending.take(), Some(PendingWorldEntry::Server { address, name })
|
||||
matches!(menu.pending.take(), Some(PendingWorldEntry::Server { address, name, .. })
|
||||
if address == "localhost:25565" && name == "Guest")
|
||||
);
|
||||
assert!(menu.pending.take().is_none(), "an entry is consumed once");
|
||||
|
||||
@@ -78,7 +78,10 @@ pub const MAP_SLOTS: usize = 256;
|
||||
/// The atlas slot the minimap extra draws into.
|
||||
pub const MINIMAP_SPRITE: &str = "horizon/minimap";
|
||||
/// Atlas slots for downloaded player skins (`skins/<sha1>`), 64x64 each.
|
||||
pub const SKIN_SLOTS: usize = 32;
|
||||
/// Vanilla registers a texture per skin. Here a skin evicted from its slot
|
||||
/// is not stored again, and its player falls back to the default skin, so
|
||||
/// the slots must cover a busy server's player list.
|
||||
pub const SKIN_SLOTS: usize = 128;
|
||||
/// Reused by the visible rows of the classic world selector.
|
||||
pub const WORLD_ICON_SLOTS: usize = 32;
|
||||
/// Atlas slots for the pack icons on the pack screen, one per icon drawn
|
||||
|
||||
@@ -1984,7 +1984,9 @@ impl Hub {
|
||||
S::PlayerInput(p) => {
|
||||
self.guests[i].input = p.flags;
|
||||
self.guests[i].sneaking = p.flags & 32 != 0;
|
||||
self.guests[i].sprinting = p.flags & 64 != 0 && p.flags & 1 != 0;
|
||||
// handlePlayerInput only records keys and updates crouching.
|
||||
// Sprinting persists after the sprint key is released (or
|
||||
// starts with a double tap); PlayerCommand changes it.
|
||||
}
|
||||
// OPEN_INVENTORY (the ridden mount's inventory) and
|
||||
// START_FALL_FLYING (checked against the guest's chest slot
|
||||
|
||||
@@ -18,6 +18,7 @@ use horizon_protocol::{
|
||||
text::{Language, plain, translatable},
|
||||
};
|
||||
use std::{
|
||||
collections::HashMap,
|
||||
sync::{
|
||||
Arc, Mutex,
|
||||
atomic::{AtomicBool, Ordering},
|
||||
@@ -27,6 +28,12 @@ use std::{
|
||||
time::Duration,
|
||||
};
|
||||
|
||||
/// `CommonListenerCookie.serverCookies`: cookies the server asked the client
|
||||
/// to store (`ClientboundStoreCookiePacket`), answered to
|
||||
/// `ClientboundCookieRequestPacket`. A `transfer` carries them to the next
|
||||
/// connection (`TransferState`), so a proxy's backend switch keeps them.
|
||||
pub type Cookies = Arc<Mutex<HashMap<String, Vec<u8>>>>;
|
||||
|
||||
/// What the network thread reports to the game.
|
||||
pub enum Event {
|
||||
/// Progress text for the connecting screen.
|
||||
@@ -48,6 +55,13 @@ pub enum Event {
|
||||
PackPush(cfg::ResourcePackPush),
|
||||
/// ClientboundResourcePackPopPacket: one pack, or every pack.
|
||||
PackPop(Option<u128>),
|
||||
/// `ClientboundTransferPacket`: the server sent us to another address.
|
||||
/// The connection ends right after; the game reconnects there with the
|
||||
/// stored cookies.
|
||||
Transfer {
|
||||
host: String,
|
||||
port: i32,
|
||||
},
|
||||
/// The connection ended. `from_server`: the server gave the reason (or
|
||||
/// the connection was refused for good), rather than the connection
|
||||
/// failing (auto-reconnect retries only failures and shutdowns).
|
||||
@@ -67,6 +81,8 @@ pub struct Session {
|
||||
pub address: String,
|
||||
pub name: String,
|
||||
pub counters: Arc<Mutex<Option<Arc<Counters>>>>,
|
||||
/// The cookies this server stored on us (`ClientboundStoreCookiePacket`).
|
||||
pub cookies: Cookies,
|
||||
/// HORIZON_NET_DEBUG=1 logs every packet sent from the game thread.
|
||||
debug: bool,
|
||||
}
|
||||
@@ -79,7 +95,27 @@ impl Session {
|
||||
view_distance: i8,
|
||||
lang: Arc<Language>,
|
||||
) -> Self {
|
||||
Self::start(address, name, auth, view_distance, lang, None)
|
||||
Self::start(address, name, auth, view_distance, lang, None, None)
|
||||
}
|
||||
/// `ConnectScreen.startConnecting` for a `transfer`: the cookies the
|
||||
/// server stored carry to the new connection (`TransferState`).
|
||||
pub fn connect_transferred(
|
||||
address: &str,
|
||||
name: &str,
|
||||
auth: Option<Arc<AuthSession>>,
|
||||
view_distance: i8,
|
||||
lang: Arc<Language>,
|
||||
cookies: Cookies,
|
||||
) -> Self {
|
||||
Self::start(
|
||||
address,
|
||||
name,
|
||||
auth,
|
||||
view_distance,
|
||||
lang,
|
||||
None,
|
||||
Some(cookies),
|
||||
)
|
||||
}
|
||||
/// Join an integrated server through memory (`Connection.connectToLocalServer`).
|
||||
pub fn connect_local(
|
||||
@@ -88,7 +124,7 @@ impl Session {
|
||||
view_distance: i8,
|
||||
lang: Arc<Language>,
|
||||
) -> Self {
|
||||
Self::start("local", name, None, view_distance, lang, Some(pipe))
|
||||
Self::start("local", name, None, view_distance, lang, Some(pipe), None)
|
||||
}
|
||||
fn start(
|
||||
address: &str,
|
||||
@@ -97,12 +133,18 @@ impl Session {
|
||||
view_distance: i8,
|
||||
lang: Arc<Language>,
|
||||
local: Option<horizon_protocol::connection::Pipe>,
|
||||
cookies: Option<Cookies>,
|
||||
) -> Self {
|
||||
let (send, events) = channel();
|
||||
let writer = Arc::new(Mutex::new(None));
|
||||
let configuring = Arc::new(AtomicBool::new(true));
|
||||
let counters = Arc::new(Mutex::new(None));
|
||||
let (thread_writer, thread_counters) = (writer.clone(), counters.clone());
|
||||
// Connection.initiateServerboundPlayConnection: a transfer's
|
||||
// handshake says so (ClientIntent.TRANSFER).
|
||||
let transferred = cookies.is_some();
|
||||
let cookies = cookies.unwrap_or_default();
|
||||
let (thread_writer, thread_counters, thread_cookies) =
|
||||
(writer.clone(), counters.clone(), cookies.clone());
|
||||
let thread_configuring = configuring.clone();
|
||||
let (address_owned, name_owned) = (address.to_owned(), name.to_owned());
|
||||
let thread = std::thread::Builder::new()
|
||||
@@ -119,6 +161,8 @@ impl Session {
|
||||
&thread_writer,
|
||||
&thread_configuring,
|
||||
&thread_counters,
|
||||
&thread_cookies,
|
||||
transferred,
|
||||
);
|
||||
let from_server = result.is_ok();
|
||||
let reason = result.unwrap_or_else(|e| e);
|
||||
@@ -140,6 +184,7 @@ impl Session {
|
||||
address: address.to_owned(),
|
||||
name: name.to_owned(),
|
||||
counters,
|
||||
cookies,
|
||||
debug,
|
||||
}
|
||||
}
|
||||
@@ -291,6 +336,8 @@ fn run(
|
||||
shared_writer: &Mutex<Option<ConnWriter>>,
|
||||
configuring: &AtomicBool,
|
||||
shared_counters: &Mutex<Option<Arc<Counters>>>,
|
||||
cookies: &Cookies,
|
||||
transferred: bool,
|
||||
) -> Result<String, String> {
|
||||
let (host, port, mut c) = if let Some(pipe) = local {
|
||||
(address.to_owned(), 0, Connection::local(pipe))
|
||||
@@ -321,7 +368,11 @@ fn run(
|
||||
protocol: PROTOCOL_VERSION,
|
||||
host: host.clone(),
|
||||
port,
|
||||
intent: handshake::LOGIN,
|
||||
intent: if transferred {
|
||||
handshake::TRANSFER
|
||||
} else {
|
||||
handshake::LOGIN
|
||||
},
|
||||
})
|
||||
.encode(),
|
||||
)
|
||||
@@ -391,11 +442,14 @@ fn run(
|
||||
)
|
||||
.map_err(e)?;
|
||||
}
|
||||
// ClientHandshakePacketListenerImpl.handleRequestCookie: the
|
||||
// cookies a transfer carried over (none on a plain join).
|
||||
login::Clientbound::CookieRequest(q) => {
|
||||
let payload = cookies.lock().unwrap().get(&q.key).cloned();
|
||||
c.send(
|
||||
&login::Serverbound::CookieResponse(login::CookieResponse {
|
||||
key: q.key,
|
||||
payload: None,
|
||||
payload,
|
||||
})
|
||||
.encode(),
|
||||
)
|
||||
@@ -419,13 +473,13 @@ fn run(
|
||||
.map_err(e)?;
|
||||
let (mut reader, writer) = c.split();
|
||||
*shared_writer.lock().unwrap() = Some(writer);
|
||||
let registries = configure(&mut reader, shared_writer, configuring, lang, send)?;
|
||||
let registries = configure(&mut reader, shared_writer, configuring, lang, send, cookies)?;
|
||||
let _ = send.send(Event::Joined {
|
||||
registries: Arc::new(registries),
|
||||
uuid: profile.uuid,
|
||||
name: profile.name,
|
||||
});
|
||||
receive_play(&mut reader, shared_writer, configuring, lang, send)
|
||||
receive_play(&mut reader, shared_writer, configuring, lang, send, cookies)
|
||||
}
|
||||
|
||||
fn receive_play(
|
||||
@@ -434,6 +488,7 @@ fn receive_play(
|
||||
configuring: &AtomicBool,
|
||||
lang: &Language,
|
||||
send: &Sender<Event>,
|
||||
cookies: &Cookies,
|
||||
) -> Result<String, String> {
|
||||
loop {
|
||||
let (id, payload) = reader.recv().map_err(|e| e.to_string())?;
|
||||
@@ -469,9 +524,31 @@ fn receive_play(
|
||||
let _ = w.send(&play::Serverbound::ConfigurationAcknowledged(Empty).encode());
|
||||
configuring.store(true, Ordering::Relaxed);
|
||||
}
|
||||
let registries = configure(reader, shared_writer, configuring, lang, send)?;
|
||||
let registries =
|
||||
configure(reader, shared_writer, configuring, lang, send, cookies)?;
|
||||
let _ = send.send(Event::Reconfigured(Arc::new(registries)));
|
||||
}
|
||||
// ClientCommonPacketListenerImpl.handleRequestCookie: the stored
|
||||
// cookie (or none) goes straight back.
|
||||
play::Clientbound::CookieRequest(q) => {
|
||||
let payload = cookies.lock().unwrap().get(&q.key).cloned();
|
||||
reply(play::Serverbound::CookieResponse(cfg::CookieResponse {
|
||||
key: q.key,
|
||||
payload,
|
||||
}));
|
||||
}
|
||||
play::Clientbound::StoreCookie(p) => {
|
||||
cookies.lock().unwrap().insert(p.key, p.payload);
|
||||
}
|
||||
// ClientCommonPacketListenerImpl.handleTransfer: the connection
|
||||
// ends and the game connects to the other address.
|
||||
play::Clientbound::Transfer(p) => {
|
||||
let _ = send.send(Event::Transfer {
|
||||
host: p.host,
|
||||
port: p.port,
|
||||
});
|
||||
return Ok(tr(lang, "disconnect.transfer"));
|
||||
}
|
||||
play::Clientbound::Disconnect(d) => return Ok(plain(&d.reason, lang)),
|
||||
play::Clientbound::CustomPayload(p) if p.channel == "minecraft:brand" => {
|
||||
receive_brand(&p, send);
|
||||
@@ -493,6 +570,7 @@ fn configure(
|
||||
configuring: &AtomicBool,
|
||||
lang: &Language,
|
||||
send: &Sender<Event>,
|
||||
cookies: &Cookies,
|
||||
) -> Result<Dynamic, String> {
|
||||
let mut registries = Dynamic::default();
|
||||
let reply = |p: cfg::Serverbound| -> Result<(), String> {
|
||||
@@ -525,11 +603,22 @@ fn configure(
|
||||
let _ = send.send(Event::PackPop(p.id));
|
||||
}
|
||||
cfg::Clientbound::CookieRequest(q) => {
|
||||
let payload = cookies.lock().unwrap().get(&q.key).cloned();
|
||||
reply(cfg::Serverbound::CookieResponse(cfg::CookieResponse {
|
||||
key: q.key,
|
||||
payload: None,
|
||||
payload,
|
||||
}))?
|
||||
}
|
||||
cfg::Clientbound::StoreCookie(p) => {
|
||||
cookies.lock().unwrap().insert(p.key, p.payload);
|
||||
}
|
||||
cfg::Clientbound::Transfer(p) => {
|
||||
let _ = send.send(Event::Transfer {
|
||||
host: p.host,
|
||||
port: p.port,
|
||||
});
|
||||
return Err(tr(lang, "disconnect.transfer"));
|
||||
}
|
||||
cfg::Clientbound::Disconnect(d) => return Err(plain(&d.reason, lang)),
|
||||
cfg::Clientbound::FinishConfiguration(_) => {
|
||||
let mut w = writer.lock().unwrap();
|
||||
@@ -659,6 +748,7 @@ mod tests {
|
||||
&AtomicBool::new(false),
|
||||
&Language::new(),
|
||||
&send,
|
||||
&Cookies::default(),
|
||||
)
|
||||
});
|
||||
let mut server = Connection::local(server);
|
||||
@@ -708,6 +798,7 @@ mod tests {
|
||||
address: "local".into(),
|
||||
name: "Player".into(),
|
||||
counters: Arc::new(Mutex::new(None)),
|
||||
cookies: Cookies::default(),
|
||||
debug: false,
|
||||
};
|
||||
let (thread_writer, thread_configuring) =
|
||||
@@ -719,6 +810,7 @@ mod tests {
|
||||
&thread_configuring,
|
||||
&Language::new(),
|
||||
&send,
|
||||
&Cookies::default(),
|
||||
)
|
||||
});
|
||||
let mut server = Connection::local(server);
|
||||
@@ -749,6 +841,68 @@ mod tests {
|
||||
assert!(thread.join().unwrap().is_err());
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn play_answers_cookie_requests_from_stored_cookies_and_follows_transfers() {
|
||||
let (client, server) = horizon_protocol::connection::Pipe::pair();
|
||||
let (mut reader, writer) = Connection::local(client).split();
|
||||
let writer = Arc::new(Mutex::new(Some(writer)));
|
||||
let (send, events) = channel();
|
||||
let cookies = Cookies::default();
|
||||
let (thread_writer, thread_cookies) = (writer.clone(), cookies.clone());
|
||||
let thread = std::thread::spawn(move || {
|
||||
receive_play(
|
||||
&mut reader,
|
||||
&thread_writer,
|
||||
&AtomicBool::new(false),
|
||||
&Language::new(),
|
||||
&send,
|
||||
&thread_cookies,
|
||||
)
|
||||
});
|
||||
let mut server = Connection::local(server);
|
||||
let ask = |server: &mut Connection, key: &str| {
|
||||
let request = play::Clientbound::CookieRequest(cfg::CookieRequest { key: key.into() });
|
||||
server.send(&request.encode()).unwrap();
|
||||
let (id, body) = server.recv().unwrap();
|
||||
play::Serverbound::decode(id, &body).unwrap()
|
||||
};
|
||||
// handleRequestCookie answers an unknown key with no payload.
|
||||
assert_eq!(
|
||||
ask(&mut server, "proxy:session"),
|
||||
play::Serverbound::CookieResponse(cfg::CookieResponse {
|
||||
key: "proxy:session".into(),
|
||||
payload: None,
|
||||
})
|
||||
);
|
||||
let store = play::Clientbound::StoreCookie(cfg::StoreCookie {
|
||||
key: "proxy:session".into(),
|
||||
payload: vec![1, 2, 3],
|
||||
});
|
||||
server.send(&store.encode()).unwrap();
|
||||
assert_eq!(
|
||||
ask(&mut server, "proxy:session"),
|
||||
play::Serverbound::CookieResponse(cfg::CookieResponse {
|
||||
key: "proxy:session".into(),
|
||||
payload: Some(vec![1, 2, 3]),
|
||||
})
|
||||
);
|
||||
let transfer = play::Clientbound::Transfer(cfg::Transfer {
|
||||
host: "example.net".into(),
|
||||
port: 25566,
|
||||
});
|
||||
server.send(&transfer.encode()).unwrap();
|
||||
assert!(thread.join().unwrap().is_ok());
|
||||
assert!(matches!(
|
||||
events.try_iter().last(),
|
||||
Some(Event::Transfer { host, port: 25566 }) if host == "example.net"
|
||||
));
|
||||
// The stored cookie stays for the next connection (TransferState).
|
||||
assert_eq!(
|
||||
cookies.lock().unwrap().get("proxy:session"),
|
||||
Some(&vec![1, 2, 3])
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn server_brand_payload_is_decoded_and_invalid_or_unrelated_payloads_are_ignored() {
|
||||
let (send, events) = channel();
|
||||
|
||||
@@ -278,6 +278,65 @@ fn run<T: Send + 'static>(
|
||||
handle.join().unwrap().unwrap()
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn sprint_commands_survive_keyboard_input_changes() {
|
||||
let Some(resources) = resources() else {
|
||||
return;
|
||||
};
|
||||
let mut s = server(&resources);
|
||||
let port = s.hub.lan.port;
|
||||
let _bot = run(&mut s, move || connect(port, "Sprinter", true));
|
||||
let deadline = Instant::now() + Duration::from_secs(5);
|
||||
while s.hub.guests.is_empty() {
|
||||
s.tick(&[]);
|
||||
assert!(Instant::now() < deadline, "guest did not join");
|
||||
thread::yield_now();
|
||||
}
|
||||
let id = s.hub.guests[0].entity_id;
|
||||
s.hub.guests[0].loaded = true;
|
||||
s.hub.guests[0]
|
||||
.inbox
|
||||
.push_back(S::PlayerCommand(play::PlayerCommand {
|
||||
id,
|
||||
action: 1,
|
||||
data: 0,
|
||||
}));
|
||||
s.tick(&[]);
|
||||
assert!(s.hub.guests[0].sprinting);
|
||||
// LocalPlayer keeps sprinting after Ctrl is released while W remains
|
||||
// down. Double-tap sprint also sends forward without the sprint key.
|
||||
for flags in [65, 1, 0, 33] {
|
||||
s.hub.guests[0]
|
||||
.inbox
|
||||
.push_back(S::PlayerInput(play::PlayerInput { flags }));
|
||||
s.tick(&[]);
|
||||
let g = &s.hub.guests[0];
|
||||
assert!(
|
||||
g.sprinting,
|
||||
"keyboard input {flags} cleared the sprint flag"
|
||||
);
|
||||
assert_eq!(g.input, flags);
|
||||
assert_eq!(g.sneaking, flags & 32 != 0);
|
||||
}
|
||||
s.hub.guests[0]
|
||||
.inbox
|
||||
.push_back(S::PlayerCommand(play::PlayerCommand {
|
||||
id,
|
||||
action: 2,
|
||||
data: 0,
|
||||
}));
|
||||
s.tick(&[]);
|
||||
assert!(!s.hub.guests[0].sprinting);
|
||||
s.hub.guests[0]
|
||||
.inbox
|
||||
.push_back(S::PlayerInput(play::PlayerInput { flags: 65 }));
|
||||
s.tick(&[]);
|
||||
assert!(
|
||||
!s.hub.guests[0].sprinting,
|
||||
"keyboard input started a sprint"
|
||||
);
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn status_and_join() {
|
||||
let Some(resources) = resources() else {
|
||||
|
||||
@@ -13,8 +13,9 @@ use crate::{
|
||||
packets::{
|
||||
Empty,
|
||||
configuration::{
|
||||
ClientInformation, CustomPayload, Disconnect, KeepAlive, Ping, ResourcePackPop,
|
||||
ResourcePackPush, ResourcePackResponse, UpdateTags,
|
||||
ClientInformation, CookieRequest, CookieResponse, CustomPayload, Disconnect, KeepAlive,
|
||||
Ping, ResourcePackPop, ResourcePackPush, ResourcePackResponse, StoreCookie, Transfer,
|
||||
UpdateTags,
|
||||
},
|
||||
login::Property,
|
||||
},
|
||||
@@ -1759,6 +1760,7 @@ packet_enum!(Clientbound, crate::ids::play::clientbound {
|
||||
ContainerSetContent(ContainerSetContent) = CONTAINER_SET_CONTENT,
|
||||
ContainerSetData(ContainerSetData) = CONTAINER_SET_DATA,
|
||||
ContainerSetSlot(ContainerSetSlot) = CONTAINER_SET_SLOT,
|
||||
CookieRequest(CookieRequest) = COOKIE_REQUEST,
|
||||
CustomPayload(CustomPayload) = CUSTOM_PAYLOAD,
|
||||
Disconnect(Disconnect) = DISCONNECT,
|
||||
DisguisedChat(DisguisedChat) = DISGUISED_CHAT,
|
||||
@@ -1836,6 +1838,7 @@ packet_enum!(Clientbound, crate::ids::play::clientbound {
|
||||
SoundEntity(SoundEntity) = SOUND_ENTITY,
|
||||
StopSound(StopSound) = STOP_SOUND,
|
||||
StartConfiguration(Empty) = START_CONFIGURATION,
|
||||
StoreCookie(StoreCookie) = STORE_COOKIE,
|
||||
SwingAnimation(SwingAnimation) = SWING_ANIMATION,
|
||||
SystemChat(SystemChat) = SYSTEM_CHAT,
|
||||
TabList(TabList) = TAB_LIST,
|
||||
@@ -1843,6 +1846,7 @@ packet_enum!(Clientbound, crate::ids::play::clientbound {
|
||||
TeleportEntity(TeleportEntity) = TELEPORT_ENTITY,
|
||||
TickingState(TickingState) = TICKING_STATE,
|
||||
TickingStep(TickingStep) = TICKING_STEP,
|
||||
Transfer(Transfer) = TRANSFER,
|
||||
UpdateAdvancements(UpdateAdvancements) = UPDATE_ADVANCEMENTS,
|
||||
UpdateAttributes(UpdateAttributes) = UPDATE_ATTRIBUTES,
|
||||
LevelParticles(LevelParticles) = LEVEL_PARTICLES,
|
||||
@@ -2223,6 +2227,7 @@ packet_enum!(Serverbound, crate::ids::play::serverbound {
|
||||
ContainerButtonClick(ContainerButtonClick) = CONTAINER_BUTTON_CLICK,
|
||||
ContainerClick(ContainerClick) = CONTAINER_CLICK,
|
||||
ContainerClose(ContainerClose) = CONTAINER_CLOSE,
|
||||
CookieResponse(CookieResponse) = COOKIE_RESPONSE,
|
||||
CustomPayload(CustomPayload) = CUSTOM_PAYLOAD,
|
||||
EditBook(EditBook) = EDIT_BOOK,
|
||||
Interact(Interact) = INTERACT,
|
||||
|
||||
+52
@@ -2,6 +2,12 @@
|
||||
# It is not intended for manual editing.
|
||||
version = 4
|
||||
|
||||
[[package]]
|
||||
name = "adler2"
|
||||
version = "2.0.1"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "320119579fcad9c21884f5c4861d16174d0e06250625266f50fe6898340abefa"
|
||||
|
||||
[[package]]
|
||||
name = "atomic-waker"
|
||||
version = "1.1.2"
|
||||
@@ -92,6 +98,15 @@ version = "1.0.5"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "4e7648175b45a9a48536d676f68d918270699102aa8dab5496df06904c914600"
|
||||
|
||||
[[package]]
|
||||
name = "crc32fast"
|
||||
version = "1.5.3"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "0ba106e844045ddc02c20768ac4b0b7cb45f2cc2ecbd833ac9f5dacb183c2055"
|
||||
dependencies = [
|
||||
"cfg-if",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
name = "displaydoc"
|
||||
version = "0.2.7"
|
||||
@@ -131,6 +146,17 @@ version = "0.1.14"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "aedcfb3409746eddb02b9e19ebda1c3394f759a152e48ee875a0844d1b955484"
|
||||
|
||||
[[package]]
|
||||
name = "flate2"
|
||||
version = "1.1.10"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "6e634e2e0ebac1ee034020da1ca582e17ffe4e0f5e985823721e168928136dcb"
|
||||
dependencies = [
|
||||
"crc32fast",
|
||||
"miniz_oxide",
|
||||
"zlib-rs",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
name = "foldhash"
|
||||
version = "0.1.5"
|
||||
@@ -235,6 +261,7 @@ dependencies = [
|
||||
"serde_json",
|
||||
"tokio",
|
||||
"tower",
|
||||
"ureq",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
@@ -473,6 +500,16 @@ version = "0.3.17"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "6877bb514081ee2a7ff5ef9de3281f14a4dd4bceac4c09388074a6b5df8a139a"
|
||||
|
||||
[[package]]
|
||||
name = "miniz_oxide"
|
||||
version = "0.9.1"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "b63fbc4a50860e98e7b2aa7804ded1db5cbc3aff9193adaff57a6931bf7c4b4c"
|
||||
dependencies = [
|
||||
"adler2",
|
||||
"simd-adler32",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
name = "mio"
|
||||
version = "1.2.4"
|
||||
@@ -701,6 +738,12 @@ dependencies = [
|
||||
"libc",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
name = "simd-adler32"
|
||||
version = "0.3.10"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "3a219298ac11a56ea9a6d2120044824d6f01aeb034955e7af7bc16858527deea"
|
||||
|
||||
[[package]]
|
||||
name = "slab"
|
||||
version = "0.4.12"
|
||||
@@ -851,10 +894,13 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "02d1a66277ed75f640d608235660df48c8e3c19f3b4edb6a263315626cc3c01d"
|
||||
dependencies = [
|
||||
"base64",
|
||||
"flate2",
|
||||
"log",
|
||||
"once_cell",
|
||||
"rustls",
|
||||
"rustls-pki-types",
|
||||
"serde",
|
||||
"serde_json",
|
||||
"url",
|
||||
"webpki-roots 0.26.11",
|
||||
]
|
||||
@@ -1099,6 +1145,12 @@ dependencies = [
|
||||
"syn",
|
||||
]
|
||||
|
||||
[[package]]
|
||||
name = "zlib-rs"
|
||||
version = "0.6.8"
|
||||
source = "registry+https://github.com/rust-lang/crates.io-index"
|
||||
checksum = "b268e58e7c693d7c271f93ffc4ba3b380412554231c85bf61ca7af91042a4112"
|
||||
|
||||
[[package]]
|
||||
name = "zmij"
|
||||
version = "1.0.23"
|
||||
|
||||
@@ -19,6 +19,8 @@ rusqlite = { version = "0.37", features = ["bundled"] }
|
||||
serde = { version = "1", features = ["derive"] }
|
||||
serde_json = "1"
|
||||
ruzstd = "0.9"
|
||||
# Opens the hub's bug reports as GitHub issues (blocking, run off the async workers; rustls).
|
||||
ureq = { version = "2.12", features = ["json"] }
|
||||
|
||||
[dev-dependencies]
|
||||
# The uploader the launcher uses, against this server, end to end.
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# horizon-telemetry-server
|
||||
|
||||
This server receives what players choose to send (performance summaries, crash and bug reports, benchmark uploads: [docs/telemetry.md](../../docs/telemetry.md)) and stores it in one SQLite file. It serves anonymous totals to the website. It also keeps the live player count from the games' anonymous "I'm playing" pings, in memory only. It is one small Rust process, about 7 MB of memory when idle.
|
||||
This server receives what players choose to send (performance summaries, crash and bug reports, benchmark uploads: [docs/telemetry.md](../../docs/telemetry.md)) and stores it in one SQLite file. It serves anonymous totals to the website. It also keeps the live player count from the games' anonymous "I'm playing" pings, in memory only, and takes what players send from the hub (playhorizon.dev/hub): votes, bug reports and suggestions. It is one small Rust process, about 7 MB of memory when idle.
|
||||
|
||||
cargo run --release # in this folder: its own workspace, like the launcher's
|
||||
PORT=8080 HORIZON_TELEMETRY_DB=/data/telemetry.sqlite3 horizon-telemetry-server
|
||||
@@ -17,8 +17,15 @@ It runs at **https://telemetry.playhorizon.dev** (`DEFAULT_ENDPOINT` in `crates/
|
||||
| `GET /v1/benchmarks/summary` | Players' benchmark uploads grouped by GPU, CPU, render distance and game, for the website's Benchmarks page (below). Cached 10 minutes, same `Access-Control-Allow-Origin`. |
|
||||
| `POST /v1/live` | A game's "I'm playing" ping (JSON, at most 512 bytes). Returns 204. Returns 400 for a bad ping, 413 for one too large, 429 over the address's limit, 503 when it holds `LIVE_MAX_SESSIONS` already. |
|
||||
| `GET /v1/live` | How many play now, rounded: `playing`, `lan`, `versions`, `platforms`. Made again at most every 15 seconds, with the same `Access-Control-Allow-Origin`. |
|
||||
| `POST /hub/vote` | `{"item": "<roadmap id>", "voter": "<the browser's random id>", "up": true}`: a 👍 on a roadmap item, one per voter; `"up": false` takes it back. Returns `{"item", "votes"}`. 400 for a bad id, 429 over the address's limit. |
|
||||
| `GET /hub/votes` | `{"votes": {"<item>": n}}`. Made again at most every minute. |
|
||||
| `POST /hub/report` | A bug report from the hub's form: `{"title", "did", "happened", "expected", "version"?, "system", "name"?}`. Opens a GitHub issue at once (labels `bug` and `from-website`, the `#horizon-bugs` template, "Reported on playhorizon.dev") and returns 201 `{"id", "issue": "<url>"}`. If GitHub fails: 202 `{"id", "issue": null}`, and the upkeep tries again for a week. The same report twice in a day returns the first one's issue. 400 for an empty or too long field, 429 over the address's limit, 503 past the day's cap or without `GITHUB_TOKEN`. |
|
||||
| `POST /hub/suggest` | `{"text", "item"?, "name"?}` into the suggestion queue. Returns 202 `{"id"}`. Never published: Kira relays it to the maintainers' private channel. |
|
||||
| `GET /hub/suggestions?after=<id>&limit=100` | The queue, oldest first, for Kira: `{"suggestions": [{"id", "text", "item"?, "name"?, "created_at"}]}`. Needs `Authorization: Bearer <HORIZON_TELEMETRY_HUB_TOKEN>`: 401 without it, 404 when the server has none. |
|
||||
| `GET /healthz` | `ok` |
|
||||
|
||||
The hub's posts take JSON from the website (`OPTIONS` preflights answer with its origin). A form's hidden `website` field filled in (a bot) gets 202 and is dropped.
|
||||
|
||||
The totals are grouped per version, OS, GPU vendor and render distance. Each group has its sessions, install-days, hours played, the 14 frame-time buckets summed, and the mean p50 and p99 frame times. Groups with fewer than 5 install-days are left out. The totals also list crash counts per version. Benchmark uploads are published only through the summary below, never one by one.
|
||||
|
||||
## Benchmarks summary
|
||||
@@ -56,6 +63,8 @@ The live count is a table in memory: a session ID, when it last pinged, its vers
|
||||
|
||||
The day stored is the day the server received an item. The sender's IP address is never written down. The per-address rate limit keeps addresses in memory for an hour at most.
|
||||
|
||||
The hub keeps votes as an item ID and the browser's random ID, and reports and suggestions as their text, for `HORIZON_TELEMETRY_HUB_KEEP_DAYS` (90). Its rate limits key their buckets by a hash of the address with a key drawn at each start, in memory.
|
||||
|
||||
Raw rows are deleted after `HORIZON_TELEMETRY_RETENTION_DAYS` (180). The daily totals stay; they hold no install ID.
|
||||
|
||||
## Settings
|
||||
@@ -73,6 +82,14 @@ All are environment variables:
|
||||
- `HORIZON_TELEMETRY_LIVE_PER_HOUR` per address, pings and reads (600, bursts of 60: ten players behind one address)
|
||||
- `HORIZON_TELEMETRY_LIVE_WINDOW_SECONDS` (120)
|
||||
- `HORIZON_TELEMETRY_LIVE_MAX_SESSIONS` (200 000)
|
||||
- `HORIZON_TELEMETRY_HUB_PER_HOUR` votes and vote reads per address (600, bursts of 60: a page load is one read, and several players can share an address)
|
||||
- `HORIZON_TELEMETRY_HUB_POSTS_PER_HOUR` reports and suggestions per address (20, bursts of 2)
|
||||
- `HORIZON_TELEMETRY_HUB_REPORTS_PER_DAY` from everyone (30): each opens an issue
|
||||
- `HORIZON_TELEMETRY_HUB_SUGGESTIONS_PER_DAY` from everyone (200)
|
||||
- `HORIZON_TELEMETRY_HUB_KEEP_DAYS` (90)
|
||||
- `HORIZON_TELEMETRY_HUB_TOKEN`: the token Kira reads the suggestions with (unset: `GET /hub/suggestions` is off)
|
||||
- `HORIZON_TELEMETRY_GITHUB_TOKEN`: a fine-grained token with Issues read and write on the repository only (unset: `POST /hub/report` answers 503 and the form points to GitHub and Discord)
|
||||
- `HORIZON_TELEMETRY_GITHUB_REPO` (`ludovic111/horizon`)
|
||||
|
||||
## Hosting
|
||||
|
||||
|
||||
@@ -0,0 +1,128 @@
|
||||
//! A website bug report as a GitHub issue: the text made inert (no mentions, no cross-references, no HTML),
|
||||
//! written as the template Kira's `/report` and `#horizon-bugs` use, and the call that opens it.
|
||||
use std::time::Duration;
|
||||
|
||||
use serde_json::{Map, Value, json};
|
||||
|
||||
/// Opens an issue; its URL, or why not. The server's is [`Filer::github`]; tests give their own.
|
||||
pub type Filer = dyn Fn(&Issue) -> Result<String, String> + Send + Sync;
|
||||
|
||||
pub struct Issue {
|
||||
pub title: String,
|
||||
pub body: String,
|
||||
pub labels: Vec<String>,
|
||||
}
|
||||
|
||||
/// Labels every website report gets.
|
||||
pub const LABELS: [&str; 2] = ["bug", "from-website"];
|
||||
|
||||
/// Text people wrote, safe in an issue: no HTML, no `@` mentions, no `#12` or issue-URL cross-references,
|
||||
/// no closing keywords, no code spans to break out of. The same rules as Kira's `neutralise`.
|
||||
pub fn neutralise(text: &str) -> String {
|
||||
let mut out = String::with_capacity(text.len());
|
||||
let chars: Vec<char> = text.chars().collect();
|
||||
let mut i = 0;
|
||||
while i < chars.len() {
|
||||
let c = chars[i];
|
||||
let next = chars.get(i + 1).copied();
|
||||
let word_start = i == 0 || !chars[i - 1].is_alphanumeric();
|
||||
match c {
|
||||
'<' => out.push_str("<"),
|
||||
'>' => out.push_str(">"),
|
||||
'`' => out.push('\''),
|
||||
// A zero-width space after `@` or `#` keeps the text and drops the mention or the link.
|
||||
'@' | '#' if next.is_some_and(|n| n.is_alphanumeric()) => {
|
||||
out.push(c);
|
||||
out.push('\u{200b}');
|
||||
}
|
||||
_ if word_start && closing_keyword(&chars[i..]) => {
|
||||
out.push(c);
|
||||
out.push('\u{200b}');
|
||||
}
|
||||
_ => out.push(c),
|
||||
}
|
||||
i += 1;
|
||||
}
|
||||
// github.com/owner/repo/issues/12 links cross-reference the issue: shown, not linked.
|
||||
out.replace("github.com/", "github.com\u{200b}/")
|
||||
}
|
||||
|
||||
fn closing_keyword(rest: &[char]) -> bool {
|
||||
let word: String = rest
|
||||
.iter()
|
||||
.take_while(|c| c.is_alphabetic())
|
||||
.flat_map(|c| c.to_lowercase())
|
||||
.collect();
|
||||
[
|
||||
"close", "closes", "closed", "fix", "fixes", "fixed", "resolve", "resolves", "resolved",
|
||||
]
|
||||
.contains(&word.as_str())
|
||||
}
|
||||
|
||||
/// Text as a markdown quote, every line prefixed.
|
||||
fn quote(text: &str) -> String {
|
||||
text.lines()
|
||||
.map(|l| format!("> {l}").trim_end().to_owned())
|
||||
.collect::<Vec<_>>()
|
||||
.join("\n")
|
||||
}
|
||||
|
||||
/// The issue for a report's fields (`hub::REPORT`'s names, already checked).
|
||||
pub fn issue(fields: &Map<String, Value>) -> Issue {
|
||||
let field = |name: &str| {
|
||||
fields
|
||||
.get(name)
|
||||
.and_then(Value::as_str)
|
||||
.map(neutralise)
|
||||
.filter(|s| !s.is_empty())
|
||||
.unwrap_or_else(|| "not given".into())
|
||||
};
|
||||
let title = neutralise(&field("title").replace(['\n', '\r'], " "));
|
||||
let text = [
|
||||
format!("**What I did:**\n{}", field("did")),
|
||||
format!("**What happened:**\n{}", field("happened")),
|
||||
format!("**What I expected:**\n{}", field("expected")),
|
||||
format!("**Horizon version:** {}", field("version")),
|
||||
format!("**OS, CPU, GPU:** {}", field("system")),
|
||||
]
|
||||
.join("\n");
|
||||
let by = fields
|
||||
.get("name")
|
||||
.and_then(Value::as_str)
|
||||
.map(|n| neutralise(n).replace(['*', '_', '~', '|', '[', ']'], ""))
|
||||
.filter(|n| !n.is_empty())
|
||||
.map(|n| format!(" by **{n}**"))
|
||||
.unwrap_or_default();
|
||||
let body = format!(
|
||||
"{}\n\nReported on playhorizon.dev{by}\n\n<sub>Opened by the bug form on playhorizon.dev/hub. The reporter has this issue's link; they don't get GitHub notifications.</sub>",
|
||||
quote(&text)
|
||||
);
|
||||
Issue {
|
||||
title,
|
||||
body,
|
||||
labels: LABELS.iter().map(|l| (*l).to_owned()).collect(),
|
||||
}
|
||||
}
|
||||
|
||||
/// Opens issues in `repo` (`owner/name`) with `token` (a fine-grained token with Issues: write on that repo
|
||||
/// only). Errors never carry the token or GitHub's answer body.
|
||||
pub fn github(repo: String, token: String) -> Box<Filer> {
|
||||
Box::new(move |issue: &Issue| {
|
||||
let response = ureq::post(&format!("https://api.github.com/repos/{repo}/issues"))
|
||||
.set("Authorization", &format!("Bearer {token}"))
|
||||
.set("Accept", "application/vnd.github+json")
|
||||
.set("X-GitHub-Api-Version", "2022-11-28")
|
||||
.set("User-Agent", "horizon-telemetry-server")
|
||||
.timeout(Duration::from_secs(20))
|
||||
.send_json(json!({ "title": issue.title, "body": issue.body, "labels": issue.labels }));
|
||||
match response {
|
||||
Ok(response) => response
|
||||
.into_json::<Value>()
|
||||
.ok()
|
||||
.and_then(|v| v["html_url"].as_str().map(str::to_owned))
|
||||
.ok_or_else(|| "GitHub's answer had no issue URL".into()),
|
||||
Err(ureq::Error::Status(code, _)) => Err(format!("GitHub answered {code}")),
|
||||
Err(ureq::Error::Transport(e)) => Err(format!("could not reach GitHub: {}", e.kind())),
|
||||
}
|
||||
})
|
||||
}
|
||||
@@ -0,0 +1,242 @@
|
||||
//! The hub's votes: a 👍 on a roadmap item at playhorizon.dev/hub, and the helpers the hub's other
|
||||
//! endpoints (`intake`) share. roadmap/README.md documents them for Kira and the website.
|
||||
//!
|
||||
//! - `POST /hub/vote`: a 👍 on a roadmap item, one per browser (`voter`, a random id the page makes and
|
||||
//! keeps); `"up": false` takes it back. Answers the item's count.
|
||||
//! - `GET /hub/votes`: every item's count, cached a minute.
|
||||
//!
|
||||
//! Stored: an item id and the browser's random id per vote. Never an IP address: the rate limits key their
|
||||
//! buckets by a hash of it with a key drawn at start, in memory.
|
||||
use std::collections::HashMap;
|
||||
use std::hash::BuildHasher;
|
||||
use std::sync::Arc;
|
||||
use std::time::{Duration, Instant};
|
||||
|
||||
use axum::extract::{Request, State};
|
||||
use axum::http::{HeaderValue, StatusCode, header};
|
||||
use axum::response::Response;
|
||||
use rusqlite::params;
|
||||
use serde_json::{Map, Value, json};
|
||||
|
||||
use crate::store::Store;
|
||||
use crate::{App, json_response, peer, take};
|
||||
|
||||
pub const SCHEMA: &str = "
|
||||
CREATE TABLE IF NOT EXISTS hub_votes (item TEXT NOT NULL, voter TEXT NOT NULL, PRIMARY KEY (item, voter)) WITHOUT ROWID;
|
||||
";
|
||||
|
||||
/// Items with votes, at most: a vote for a new id past this is refused (ids are only checked for shape).
|
||||
const MAX_ITEMS: i64 = 1000;
|
||||
/// The largest body accepted: a report's fields at their limits, as JSON, fit.
|
||||
const MAX_BODY: usize = 24 * 1024;
|
||||
const VOTES_FOR: Duration = Duration::from_secs(60);
|
||||
|
||||
/// The hub's buckets: keyed by a keyed hash of the address, never the address itself.
|
||||
pub type HashedBuckets = HashMap<u64, (f64, Instant)>;
|
||||
|
||||
/// A roadmap item id's shape: lowercase words joined by dashes (tools/roadmap.py), at most 48 characters.
|
||||
pub fn item_id(id: &str) -> bool {
|
||||
(1..=48).contains(&id.len())
|
||||
&& !id.starts_with('-')
|
||||
&& !id.ends_with('-')
|
||||
&& !id.contains("--")
|
||||
&& id
|
||||
.bytes()
|
||||
.all(|b| b.is_ascii_lowercase() || b.is_ascii_digit() || b == b'-')
|
||||
}
|
||||
|
||||
/// A voter id's shape: what `crypto.randomUUID()` and similar make.
|
||||
fn voter_id(id: &str) -> bool {
|
||||
(16..=64).contains(&id.len())
|
||||
&& id
|
||||
.bytes()
|
||||
.all(|b| b.is_ascii_alphanumeric() || b == b'-' || b == b'_')
|
||||
}
|
||||
|
||||
impl Store {
|
||||
/// Adds or takes back a vote; the item's count after it. None when the item would be one too many.
|
||||
pub fn vote(&mut self, item: &str, voter: &str, up: bool) -> rusqlite::Result<Option<i64>> {
|
||||
let tx = self.db.transaction()?;
|
||||
if up {
|
||||
let known = tx
|
||||
.prepare("SELECT 1 FROM hub_votes WHERE item = ?1 LIMIT 1")?
|
||||
.exists([item])?;
|
||||
let items: i64 =
|
||||
tx.query_row("SELECT count(DISTINCT item) FROM hub_votes", [], |r| {
|
||||
r.get(0)
|
||||
})?;
|
||||
if !known && items >= MAX_ITEMS {
|
||||
return Ok(None);
|
||||
}
|
||||
tx.execute(
|
||||
"INSERT OR IGNORE INTO hub_votes (item, voter) VALUES (?1, ?2)",
|
||||
params![item, voter],
|
||||
)?;
|
||||
} else {
|
||||
tx.execute(
|
||||
"DELETE FROM hub_votes WHERE item = ?1 AND voter = ?2",
|
||||
params![item, voter],
|
||||
)?;
|
||||
}
|
||||
let count = tx.query_row(
|
||||
"SELECT count(*) FROM hub_votes WHERE item = ?1",
|
||||
[item],
|
||||
|r| r.get(0),
|
||||
)?;
|
||||
tx.commit()?;
|
||||
Ok(Some(count))
|
||||
}
|
||||
|
||||
/// Every item's count.
|
||||
pub fn votes(&self) -> rusqlite::Result<Map<String, Value>> {
|
||||
let mut statement = self
|
||||
.db
|
||||
.prepare("SELECT item, count(*) FROM hub_votes GROUP BY item ORDER BY item")?;
|
||||
let rows =
|
||||
statement.query_map([], |r| Ok((r.get::<_, String>(0)?, r.get::<_, i64>(1)?)))?;
|
||||
rows.map(|row| row.map(|(item, n)| (item, Value::from(n))))
|
||||
.collect()
|
||||
}
|
||||
}
|
||||
|
||||
impl App {
|
||||
pub(crate) fn hashed(&self, req: &Request) -> u64 {
|
||||
self.hub_key.hash_one(self.client(req.headers(), peer(req)))
|
||||
}
|
||||
|
||||
/// Takes a token from the address's hub bucket (votes and reads of the counts).
|
||||
fn allow_hub(&self, req: &Request) -> bool {
|
||||
take(
|
||||
&self.hub_buckets,
|
||||
self.config.hub_per_hour,
|
||||
self.hashed(req),
|
||||
)
|
||||
}
|
||||
|
||||
/// The hub's share of `maintain`: idle buckets are forgotten.
|
||||
pub(crate) fn forget_hub_buckets(&self) {
|
||||
for buckets in [&self.hub_buckets, &self.hub_post_buckets] {
|
||||
buckets
|
||||
.lock()
|
||||
.unwrap_or_else(|e| e.into_inner())
|
||||
.retain(|_, (_, at)| at.elapsed() < Duration::from_secs(3600));
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
/// A JSON answer to the website: its origin may read it, nothing caches it.
|
||||
pub(crate) fn answer(app: &App, code: StatusCode, body: Value) -> Response {
|
||||
let mut response = json_response(app, body.to_string(), 0);
|
||||
*response.status_mut() = code;
|
||||
response
|
||||
.headers_mut()
|
||||
.insert(header::CACHE_CONTROL, HeaderValue::from_static("no-store"));
|
||||
response
|
||||
}
|
||||
|
||||
pub(crate) fn refuse(app: &App, code: StatusCode, message: &str) -> Response {
|
||||
answer(app, code, json!({ "error": message }))
|
||||
}
|
||||
|
||||
/// A browser's preflight for the JSON posts: the website may post them.
|
||||
pub async fn preflight(State(app): State<Arc<App>>) -> Response {
|
||||
let mut response = answer(&app, StatusCode::NO_CONTENT, Value::Null);
|
||||
*response.body_mut() = axum::body::Body::empty();
|
||||
let headers = response.headers_mut();
|
||||
headers.remove(header::CONTENT_TYPE);
|
||||
headers.insert(
|
||||
header::ACCESS_CONTROL_ALLOW_METHODS,
|
||||
HeaderValue::from_static("POST"),
|
||||
);
|
||||
headers.insert(
|
||||
header::ACCESS_CONTROL_ALLOW_HEADERS,
|
||||
HeaderValue::from_static("content-type"),
|
||||
);
|
||||
headers.insert(
|
||||
header::ACCESS_CONTROL_MAX_AGE,
|
||||
HeaderValue::from_static("86400"),
|
||||
);
|
||||
response
|
||||
}
|
||||
|
||||
pub(crate) async fn json_body(req: Request) -> Result<Value, &'static str> {
|
||||
let bytes = axum::body::to_bytes(req.into_body(), MAX_BODY)
|
||||
.await
|
||||
.map_err(|_| "too large")?;
|
||||
serde_json::from_slice(&bytes).map_err(|_| "send JSON")
|
||||
}
|
||||
|
||||
/// `POST /hub/vote` `{"item", "voter", "up"}`: 200 `{"item", "votes"}`.
|
||||
pub async fn vote(State(app): State<Arc<App>>, req: Request) -> Response {
|
||||
if !app.allow_hub(&req) {
|
||||
return refuse(&app, StatusCode::TOO_MANY_REQUESTS, "too many requests");
|
||||
}
|
||||
let body = match json_body(req).await {
|
||||
Ok(body) => body,
|
||||
Err(e) => return refuse(&app, StatusCode::BAD_REQUEST, e),
|
||||
};
|
||||
let item = body["item"].as_str().unwrap_or("");
|
||||
let voter = body["voter"].as_str().unwrap_or("");
|
||||
if !item_id(item) || !voter_id(voter) {
|
||||
return refuse(&app, StatusCode::BAD_REQUEST, "an item id and a voter id");
|
||||
}
|
||||
let up = body["up"].as_bool().unwrap_or(true);
|
||||
let counted = app.store().vote(item, voter, up);
|
||||
match counted {
|
||||
Ok(Some(votes)) => {
|
||||
*app.votes_cache.lock().unwrap_or_else(|e| e.into_inner()) = None;
|
||||
answer(
|
||||
&app,
|
||||
StatusCode::OK,
|
||||
json!({ "item": item, "votes": votes }),
|
||||
)
|
||||
}
|
||||
Ok(None) => refuse(&app, StatusCode::BAD_REQUEST, "no such item"),
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: could not store a vote: {e}");
|
||||
refuse(&app, StatusCode::SERVICE_UNAVAILABLE, "try again later")
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
/// `GET /hub/votes`: `{"votes": {"<item>": n}}`, made again at most every minute.
|
||||
pub async fn votes(State(app): State<Arc<App>>, req: Request) -> Response {
|
||||
if !app.allow_hub(&req) {
|
||||
return refuse(&app, StatusCode::TOO_MANY_REQUESTS, "too many requests");
|
||||
}
|
||||
let json = {
|
||||
let mut cache = app.votes_cache.lock().unwrap_or_else(|e| e.into_inner());
|
||||
match &*cache {
|
||||
Some((at, json)) if at.elapsed() < VOTES_FOR => json.clone(),
|
||||
_ => {
|
||||
let counts = app.store().votes();
|
||||
match counts {
|
||||
Ok(counts) => {
|
||||
let json = json!({ "votes": counts }).to_string();
|
||||
*cache = Some((Instant::now(), json.clone()));
|
||||
json
|
||||
}
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: could not read the votes: {e}");
|
||||
return refuse(&app, StatusCode::SERVICE_UNAVAILABLE, "try again later");
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
};
|
||||
json_response(&app, json, VOTES_FOR.as_secs())
|
||||
}
|
||||
|
||||
#[cfg(test)]
|
||||
mod tests {
|
||||
use super::*;
|
||||
|
||||
#[test]
|
||||
fn ids_are_checked_for_shape() {
|
||||
assert!(item_id("smooth-frames") && item_id("v2"));
|
||||
for bad in ["", "-a", "a-", "a--b", "Smooth", "a b", &"a".repeat(49)] {
|
||||
assert!(!item_id(bad), "{bad}");
|
||||
}
|
||||
assert!(voter_id("0b7c3c9e-3f0a-4d8e-9a39-4c1f5a6b7d21") && !voter_id("short"));
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,370 @@
|
||||
//! What players send from the hub (playhorizon.dev/hub) for the maintainers: bug reports and suggestions.
|
||||
//! roadmap/README.md documents it for Kira and the website.
|
||||
//!
|
||||
//! - `POST /hub/report`: a bug report, opened at once as a GitHub issue (labels `bug`, `from-website`) in
|
||||
//! the template Kira's `/report` uses (`github`). Kept and tried again by the upkeep if GitHub fails.
|
||||
//! - `POST /hub/suggest`: a suggestion, into the queue. Never published: Kira relays it to the
|
||||
//! maintainers' private channel.
|
||||
//! - `GET /hub/suggestions?after=<id>`: the queue for Kira, with the `HORIZON_TELEMETRY_HUB_TOKEN` bearer.
|
||||
//!
|
||||
//! Stored: reports and suggestions as their text, for `hub_keep_days`. Never an IP address.
|
||||
use std::sync::Arc;
|
||||
|
||||
use axum::extract::{Query, Request, State};
|
||||
use axum::http::{HeaderMap, HeaderValue, StatusCode, header};
|
||||
use axum::response::{IntoResponse, Response};
|
||||
use rusqlite::params;
|
||||
use serde::Deserialize;
|
||||
use serde_json::{Map, Value, json};
|
||||
|
||||
use crate::hub::{answer, item_id, json_body, refuse};
|
||||
use crate::store::Store;
|
||||
use crate::{App, github, take, utc_now};
|
||||
|
||||
pub const SCHEMA: &str = "
|
||||
CREATE TABLE IF NOT EXISTS hub_queue (
|
||||
id INTEGER PRIMARY KEY, kind TEXT NOT NULL, day INTEGER NOT NULL, created TEXT NOT NULL,
|
||||
state TEXT NOT NULL DEFAULT 'new', issue TEXT NOT NULL DEFAULT '', body TEXT NOT NULL
|
||||
);
|
||||
CREATE INDEX IF NOT EXISTS hub_queue_kind ON hub_queue (kind, state, id);
|
||||
";
|
||||
|
||||
/// Days the upkeep keeps trying to open a report's issue.
|
||||
const RETRY_DAYS: u32 = 7;
|
||||
|
||||
/// A field's rules: its name, whether it is needed, its length in characters, whether it may hold lines.
|
||||
struct Field(&'static str, bool, std::ops::RangeInclusive<usize>, bool);
|
||||
|
||||
/// A bug report: the `#horizon-bugs` template's fields.
|
||||
const REPORT: &[Field] = &[
|
||||
Field("title", true, 5..=120, false),
|
||||
Field("did", true, 3..=2000, true),
|
||||
Field("happened", true, 3..=2000, true),
|
||||
Field("expected", true, 3..=2000, true),
|
||||
Field("version", false, 0..=60, false),
|
||||
Field("system", true, 3..=200, false),
|
||||
Field("name", false, 0..=64, false),
|
||||
];
|
||||
const SUGGESTION: &[Field] = &[
|
||||
Field("text", true, 10..=1000, true),
|
||||
Field("item", false, 0..=48, false),
|
||||
Field("name", false, 0..=64, false),
|
||||
];
|
||||
|
||||
/// Text as stored: no control characters but line breaks (where allowed), trimmed.
|
||||
fn clean(text: &str, lines: bool) -> String {
|
||||
let text = text.replace("\r\n", "\n");
|
||||
let kept: String = text
|
||||
.chars()
|
||||
.map(|c| if !lines && c == '\n' { ' ' } else { c })
|
||||
.filter(|c| !c.is_control() || (lines && *c == '\n'))
|
||||
.collect();
|
||||
kept.trim().to_owned()
|
||||
}
|
||||
|
||||
/// The request's fields checked against `rules`: the cleaned object, or what is wrong.
|
||||
fn fields(body: &Value, rules: &[Field]) -> Result<Map<String, Value>, String> {
|
||||
let object = body.as_object().ok_or("send a JSON object")?;
|
||||
let mut out = Map::new();
|
||||
for Field(name, needed, length, lines) in rules {
|
||||
let text = match object.get(*name) {
|
||||
None | Some(Value::Null) => String::new(),
|
||||
Some(Value::String(s)) => clean(s, *lines),
|
||||
Some(_) => return Err(format!("{name} is text")),
|
||||
};
|
||||
if text.is_empty() && !needed {
|
||||
continue;
|
||||
}
|
||||
if !length.contains(&text.chars().count()) {
|
||||
return Err(format!(
|
||||
"{name}: {} to {} characters",
|
||||
length.start(),
|
||||
length.end()
|
||||
));
|
||||
}
|
||||
out.insert((*name).to_owned(), Value::String(text));
|
||||
}
|
||||
Ok(out)
|
||||
}
|
||||
|
||||
impl Store {
|
||||
/// How many entries of `kind` came in on `day`.
|
||||
pub fn queued_on(&self, kind: &str, day: u32) -> rusqlite::Result<u32> {
|
||||
self.db.query_row(
|
||||
"SELECT count(*) FROM hub_queue WHERE kind = ?1 AND day = ?2",
|
||||
params![kind, day],
|
||||
|r| r.get(0),
|
||||
)
|
||||
}
|
||||
|
||||
/// Queues an entry: its id, and its issue when the same text already came in since `since` and was
|
||||
/// opened (a double click, a form sent twice).
|
||||
pub fn enqueue(
|
||||
&mut self,
|
||||
kind: &str,
|
||||
day: u32,
|
||||
since: u32,
|
||||
body: &Map<String, Value>,
|
||||
) -> rusqlite::Result<(i64, Option<String>)> {
|
||||
let body = Value::Object(body.clone()).to_string();
|
||||
let same = self
|
||||
.db
|
||||
.prepare(
|
||||
"SELECT id, issue FROM hub_queue WHERE kind = ?1 AND body = ?2 AND day >= ?3 LIMIT 1",
|
||||
)?
|
||||
.query_row(params![kind, body, since], |r| {
|
||||
Ok((r.get::<_, i64>(0)?, r.get::<_, String>(1)?))
|
||||
});
|
||||
match same {
|
||||
Ok((id, issue)) => return Ok((id, Some(issue).filter(|i| !i.is_empty()))),
|
||||
Err(rusqlite::Error::QueryReturnedNoRows) => {}
|
||||
Err(e) => return Err(e),
|
||||
}
|
||||
self.db.execute(
|
||||
"INSERT INTO hub_queue (kind, day, created, body) VALUES (?1, ?2, ?3, ?4)",
|
||||
params![kind, day, utc_now(), body],
|
||||
)?;
|
||||
Ok((self.db.last_insert_rowid(), None))
|
||||
}
|
||||
|
||||
/// Suggestions after `after`, oldest first: `{id, text, item?, name?, created_at}`.
|
||||
pub fn suggestions(&self, after: i64, limit: u32) -> rusqlite::Result<Vec<Value>> {
|
||||
let mut statement = self.db.prepare(
|
||||
"SELECT id, created, body FROM hub_queue WHERE kind = 'suggestion' AND id > ?1 ORDER BY id LIMIT ?2",
|
||||
)?;
|
||||
let rows = statement.query_map(params![after, limit], |r| {
|
||||
let mut entry: Map<String, Value> =
|
||||
serde_json::from_str(&r.get::<_, String>(2)?).unwrap_or_default();
|
||||
entry.insert("id".into(), r.get::<_, i64>(0)?.into());
|
||||
entry.insert("created_at".into(), r.get::<_, String>(1)?.into());
|
||||
Ok(Value::Object(entry))
|
||||
})?;
|
||||
rows.collect()
|
||||
}
|
||||
|
||||
/// Reports whose issue isn't open yet, from `since` on: id and fields.
|
||||
pub fn unfiled(&self, since: u32) -> rusqlite::Result<Vec<(i64, Map<String, Value>)>> {
|
||||
let mut statement = self.db.prepare(
|
||||
"SELECT id, body FROM hub_queue WHERE kind = 'report' AND state = 'new' AND day >= ?1 ORDER BY id",
|
||||
)?;
|
||||
let rows = statement.query_map([since], |r| {
|
||||
Ok((
|
||||
r.get::<_, i64>(0)?,
|
||||
serde_json::from_str(&r.get::<_, String>(1)?).unwrap_or_default(),
|
||||
))
|
||||
})?;
|
||||
rows.collect()
|
||||
}
|
||||
|
||||
/// Marks a report as opened: `issue` is its URL.
|
||||
pub fn filed(&mut self, id: i64, issue: &str) -> rusqlite::Result<()> {
|
||||
self.db.execute(
|
||||
"UPDATE hub_queue SET state = 'filed', issue = ?2 WHERE id = ?1",
|
||||
params![id, issue],
|
||||
)?;
|
||||
Ok(())
|
||||
}
|
||||
|
||||
/// Reports from before `retry_from` that never got an issue are given up; entries before `oldest_day`
|
||||
/// go.
|
||||
pub fn expire_queue(&mut self, oldest_day: u32, retry_from: u32) -> rusqlite::Result<usize> {
|
||||
self.db.execute(
|
||||
"UPDATE hub_queue SET state = 'failed' WHERE kind = 'report' AND state = 'new' AND day < ?1",
|
||||
[retry_from],
|
||||
)?;
|
||||
self.db
|
||||
.execute("DELETE FROM hub_queue WHERE day < ?1", [oldest_day])
|
||||
}
|
||||
}
|
||||
|
||||
impl App {
|
||||
/// The same for reports and suggestions, a much smaller bucket.
|
||||
fn allow_post(&self, req: &Request) -> bool {
|
||||
take(
|
||||
&self.hub_post_buckets,
|
||||
self.config.hub_posts_per_hour,
|
||||
self.hashed(req),
|
||||
)
|
||||
}
|
||||
|
||||
/// Opens the reports whose issue isn't open yet (the upkeep calls it off the async workers; it blocks).
|
||||
/// Stops at the first failure: GitHub is down or the token is wrong, the next round tries again.
|
||||
pub fn file_pending(&self) {
|
||||
let Some(filer) = &self.filer else { return };
|
||||
let since = (self.today)().saturating_sub(RETRY_DAYS);
|
||||
let pending = self.store().unfiled(since).unwrap_or_default();
|
||||
for (id, fields) in pending {
|
||||
match filer(&github::issue(&fields)) {
|
||||
Ok(url) => self.mark_filed(id, &url),
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: report {id} still not opened: {e}");
|
||||
return;
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
fn mark_filed(&self, id: i64, url: &str) {
|
||||
let marked = self.store().filed(id, url);
|
||||
if let Err(e) = marked {
|
||||
eprintln!("horizon-telemetry-server: report {id} opened as {url}, not marked: {e}");
|
||||
}
|
||||
}
|
||||
|
||||
/// The intake's share of `maintain`: entries past `hub_keep_days` go, reports never opened after
|
||||
/// [`RETRY_DAYS`] are given up.
|
||||
pub(crate) fn expire_intake(&self) -> rusqlite::Result<usize> {
|
||||
let today = (self.today)();
|
||||
self.store().expire_queue(
|
||||
today.saturating_sub(self.config.hub_keep_days),
|
||||
today.saturating_sub(RETRY_DAYS),
|
||||
)
|
||||
}
|
||||
}
|
||||
|
||||
/// What `receive` keeps: the entry's id, its issue if already opened, its fields.
|
||||
type Received = (i64, Option<String>, Map<String, Value>);
|
||||
|
||||
/// Checks a report or a suggestion and queues it.
|
||||
async fn receive(
|
||||
app: &App,
|
||||
req: Request,
|
||||
kind: &str,
|
||||
rules: &[Field],
|
||||
per_day: u32,
|
||||
) -> Result<Received, Box<Response>> {
|
||||
let no = |code: StatusCode, message: &str| Box::new(refuse(app, code, message));
|
||||
if !app.allow_post(&req) {
|
||||
return Err(no(StatusCode::TOO_MANY_REQUESTS, "too many requests"));
|
||||
}
|
||||
let body = json_body(req)
|
||||
.await
|
||||
.map_err(|e| no(StatusCode::BAD_REQUEST, e))?;
|
||||
// The form's hidden field, which people leave empty and form-filling bots don't: thanked, dropped.
|
||||
if body["website"].as_str().is_some_and(|s| !s.is_empty()) {
|
||||
let thanks = answer(app, StatusCode::ACCEPTED, json!({ "id": 0 }));
|
||||
return Err(Box::new(thanks));
|
||||
}
|
||||
let entry = fields(&body, rules).map_err(|e| no(StatusCode::BAD_REQUEST, &e))?;
|
||||
if let Some(item) = entry.get("item").and_then(Value::as_str)
|
||||
&& !item_id(item)
|
||||
{
|
||||
return Err(no(StatusCode::BAD_REQUEST, "item: a roadmap item id"));
|
||||
}
|
||||
let today = (app.today)();
|
||||
let mut store = app.store();
|
||||
if store.queued_on(kind, today).unwrap_or(u32::MAX) >= per_day {
|
||||
let full = "too many today: please try again tomorrow";
|
||||
return Err(no(StatusCode::SERVICE_UNAVAILABLE, full));
|
||||
}
|
||||
match store.enqueue(kind, today, today.saturating_sub(1), &entry) {
|
||||
Ok((id, issue)) => Ok((id, issue, entry)),
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: could not queue a {kind}: {e}");
|
||||
Err(no(StatusCode::SERVICE_UNAVAILABLE, "try again later"))
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
/// `POST /hub/report` `{"title", "did", "happened", "expected", "version"?, "system", "name"?}`: 201
|
||||
/// `{"id", "issue"}` once the issue is open, 202 `{"id", "issue": null}` when GitHub failed and the upkeep
|
||||
/// will try again; 503 when reports are off (no GitHub token).
|
||||
pub async fn report(State(app): State<Arc<App>>, req: Request) -> Response {
|
||||
let Some(filer) = app.filer.clone() else {
|
||||
return refuse(
|
||||
&app,
|
||||
StatusCode::SERVICE_UNAVAILABLE,
|
||||
"reports are closed here: use GitHub or Discord",
|
||||
);
|
||||
};
|
||||
let per_day = app.config.hub_reports_per_day;
|
||||
let (id, issue, fields) = match receive(&app, req, "report", REPORT, per_day).await {
|
||||
Ok(received) => received,
|
||||
Err(response) => return *response,
|
||||
};
|
||||
if let Some(issue) = issue {
|
||||
return answer(
|
||||
&app,
|
||||
StatusCode::CREATED,
|
||||
json!({ "id": id, "issue": issue }),
|
||||
);
|
||||
}
|
||||
let opened = tokio::task::spawn_blocking(move || filer(&github::issue(&fields)))
|
||||
.await
|
||||
.map_err(|e| e.to_string())
|
||||
.and_then(|opened| opened);
|
||||
match opened {
|
||||
Ok(url) => {
|
||||
app.mark_filed(id, &url);
|
||||
answer(&app, StatusCode::CREATED, json!({ "id": id, "issue": url }))
|
||||
}
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: report {id} not opened yet: {e}");
|
||||
answer(
|
||||
&app,
|
||||
StatusCode::ACCEPTED,
|
||||
json!({ "id": id, "issue": null }),
|
||||
)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
/// `POST /hub/suggest` `{"text", "item"?, "name"?}`: 202 `{"id"}`.
|
||||
pub async fn suggest(State(app): State<Arc<App>>, req: Request) -> Response {
|
||||
let per_day = app.config.hub_suggestions_per_day;
|
||||
match receive(&app, req, "suggestion", SUGGESTION, per_day).await {
|
||||
Ok((id, ..)) => answer(&app, StatusCode::ACCEPTED, json!({ "id": id })),
|
||||
Err(response) => *response,
|
||||
}
|
||||
}
|
||||
|
||||
#[derive(Deserialize)]
|
||||
pub struct After {
|
||||
after: Option<i64>,
|
||||
limit: Option<u32>,
|
||||
}
|
||||
|
||||
/// `GET /hub/suggestions?after=<id>&limit=100` with `Authorization: Bearer <HORIZON_TELEMETRY_HUB_TOKEN>`:
|
||||
/// `{"suggestions": [{"id", "text", "item"?, "name"?, "created_at"}]}`, oldest first. 404 when no token is
|
||||
/// set, 401 for a wrong one.
|
||||
pub async fn suggestions(
|
||||
State(app): State<Arc<App>>,
|
||||
headers: HeaderMap,
|
||||
Query(after): Query<After>,
|
||||
) -> Response {
|
||||
let Some(token) = app.config.hub_token.as_deref() else {
|
||||
return StatusCode::NOT_FOUND.into_response();
|
||||
};
|
||||
let sent = headers
|
||||
.get(header::AUTHORIZATION)
|
||||
.and_then(|v| v.to_str().ok())
|
||||
.and_then(|v| v.strip_prefix("Bearer "))
|
||||
.unwrap_or("");
|
||||
if !same(sent.as_bytes(), token.as_bytes()) {
|
||||
return StatusCode::UNAUTHORIZED.into_response();
|
||||
}
|
||||
let limit = after.limit.unwrap_or(100).clamp(1, 500);
|
||||
let listed = app.store().suggestions(after.after.unwrap_or(0), limit);
|
||||
match listed {
|
||||
Ok(list) => (
|
||||
[
|
||||
(
|
||||
header::CONTENT_TYPE,
|
||||
HeaderValue::from_static("application/json"),
|
||||
),
|
||||
(header::CACHE_CONTROL, HeaderValue::from_static("no-store")),
|
||||
],
|
||||
json!({ "suggestions": list }).to_string(),
|
||||
)
|
||||
.into_response(),
|
||||
Err(e) => {
|
||||
eprintln!("horizon-telemetry-server: could not read the suggestions: {e}");
|
||||
StatusCode::SERVICE_UNAVAILABLE.into_response()
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
/// Equal, in a time that doesn't depend on where they differ.
|
||||
fn same(a: &[u8], b: &[u8]) -> bool {
|
||||
a.len() == b.len() && a.iter().zip(b).fold(0, |diff, (x, y)| diff | (x ^ y)) == 0
|
||||
}
|
||||
@@ -7,6 +7,7 @@
|
||||
//! least 3 installs only (`summary`), cached; the website's Benchmarks page reads it.
|
||||
//! - `POST /v1/live`: a game's anonymous "I'm playing" ping (`live`, in memory only).
|
||||
//! - `GET /v1/live`: how many play now, rounded, cached briefly.
|
||||
//! - `/hub/…`: the hub's votes (`hub`), bug reports and suggestions (`intake`).
|
||||
//! - `GET /healthz`.
|
||||
//!
|
||||
//! Abuse limits: a token bucket per IP address (kept in memory for an hour, never stored), a
|
||||
@@ -15,6 +16,7 @@
|
||||
//! rows expire after `retention_days`; the daily totals stay. One small process and one SQLite
|
||||
//! file: see `README.md` for running it.
|
||||
use std::collections::HashMap;
|
||||
use std::hash::{Hash, RandomState};
|
||||
use std::net::{IpAddr, SocketAddr};
|
||||
use std::sync::{Arc, Mutex};
|
||||
use std::time::{Duration, Instant};
|
||||
@@ -27,10 +29,14 @@ use axum::routing::{delete, get, post};
|
||||
use horizon_telemetry::batch;
|
||||
|
||||
pub mod classes;
|
||||
pub mod github;
|
||||
pub mod hub;
|
||||
pub mod intake;
|
||||
pub mod live;
|
||||
pub mod store;
|
||||
pub mod summary;
|
||||
|
||||
use github::Filer;
|
||||
use horizon_telemetry::live::{MAX_PING_BYTES, Ping};
|
||||
use live::Live;
|
||||
use store::Store;
|
||||
@@ -56,6 +62,22 @@ pub struct Config {
|
||||
pub live_window: Duration,
|
||||
/// Sessions the live count holds at most; a new one past that is refused.
|
||||
pub live_max_sessions: usize,
|
||||
/// The hub's votes and reads of their counts an IP address may make an hour.
|
||||
pub hub_per_hour: f64,
|
||||
/// Bug reports and suggestions together an IP address may send an hour.
|
||||
pub hub_posts_per_hour: f64,
|
||||
/// Bug reports taken a day, from everyone: each one opens a GitHub issue.
|
||||
pub hub_reports_per_day: u32,
|
||||
/// Suggestions taken a day, from everyone.
|
||||
pub hub_suggestions_per_day: u32,
|
||||
/// Days reports and suggestions are kept (Kira has relayed them long before).
|
||||
pub hub_keep_days: u32,
|
||||
/// The bearer token `GET /hub/suggestions` wants (Kira's); unset, it answers 404.
|
||||
pub hub_token: Option<String>,
|
||||
/// Opens the website's bug reports as issues; unset, `POST /hub/report` answers 503.
|
||||
pub github_token: Option<String>,
|
||||
/// Where those issues go, `owner/name`.
|
||||
pub github_repo: String,
|
||||
}
|
||||
|
||||
impl Default for Config {
|
||||
@@ -70,6 +92,14 @@ impl Default for Config {
|
||||
live_per_hour: 600.0,
|
||||
live_window: horizon_telemetry::live::WINDOW,
|
||||
live_max_sessions: 200_000,
|
||||
hub_per_hour: 600.0,
|
||||
hub_posts_per_hour: 20.0,
|
||||
hub_reports_per_day: 30,
|
||||
hub_suggestions_per_day: 200,
|
||||
hub_keep_days: 90,
|
||||
hub_token: None,
|
||||
github_token: None,
|
||||
github_repo: "ludovic111/horizon".into(),
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -77,9 +107,16 @@ impl Default for Config {
|
||||
impl Config {
|
||||
/// The defaults, with `HORIZON_TELEMETRY_RETENTION_DAYS`, `…_MIN_INSTALL_DAYS`,
|
||||
/// `…_REQUESTS_PER_HOUR`, `…_ITEMS_PER_DAY`, `…_TRUST_PROXY` (1), `…_ALLOW_ORIGIN`,
|
||||
/// `…_LIVE_PER_HOUR`, `…_LIVE_WINDOW_SECONDS` and `…_LIVE_MAX_SESSIONS`.
|
||||
/// `…_LIVE_PER_HOUR`, `…_LIVE_WINDOW_SECONDS`, `…_LIVE_MAX_SESSIONS`, `…_HUB_PER_HOUR`,
|
||||
/// `…_HUB_POSTS_PER_HOUR`, `…_HUB_REPORTS_PER_DAY`, `…_HUB_SUGGESTIONS_PER_DAY`, `…_HUB_KEEP_DAYS`,
|
||||
/// `…_HUB_TOKEN`, `…_GITHUB_TOKEN` and `…_GITHUB_REPO`. Empty tokens count as unset.
|
||||
pub fn from_env() -> Self {
|
||||
let var = |k: &str| std::env::var(format!("HORIZON_TELEMETRY_{k}")).ok();
|
||||
let secret = |k: &str| {
|
||||
var(k)
|
||||
.map(|v| v.trim().to_owned())
|
||||
.filter(|v| !v.is_empty())
|
||||
};
|
||||
let d = Self::default();
|
||||
Self {
|
||||
retention_days: var("RETENTION_DAYS")
|
||||
@@ -105,6 +142,24 @@ impl Config {
|
||||
live_max_sessions: var("LIVE_MAX_SESSIONS")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.live_max_sessions),
|
||||
hub_per_hour: var("HUB_PER_HOUR")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.hub_per_hour),
|
||||
hub_posts_per_hour: var("HUB_POSTS_PER_HOUR")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.hub_posts_per_hour),
|
||||
hub_reports_per_day: var("HUB_REPORTS_PER_DAY")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.hub_reports_per_day),
|
||||
hub_suggestions_per_day: var("HUB_SUGGESTIONS_PER_DAY")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.hub_suggestions_per_day),
|
||||
hub_keep_days: var("HUB_KEEP_DAYS")
|
||||
.and_then(|v| v.parse().ok())
|
||||
.unwrap_or(d.hub_keep_days),
|
||||
hub_token: secret("HUB_TOKEN"),
|
||||
github_token: secret("GITHUB_TOKEN"),
|
||||
github_repo: var("GITHUB_REPO").unwrap_or(d.github_repo),
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -126,6 +181,16 @@ pub struct App {
|
||||
summary_cache: Mutex<Option<(Instant, String)>>,
|
||||
/// Today, in days since 1970 (a test moves it).
|
||||
today: Box<dyn Fn() -> u32 + Send + Sync>,
|
||||
/// The key the hub's buckets hash addresses with, drawn at start and never stored.
|
||||
hub_key: RandomState,
|
||||
/// The hub's votes and vote counts, per hashed address.
|
||||
hub_buckets: Mutex<hub::HashedBuckets>,
|
||||
/// The hub's reports and suggestions, per hashed address.
|
||||
hub_post_buckets: Mutex<hub::HashedBuckets>,
|
||||
/// `GET /hub/votes`'s answer and when it was made.
|
||||
votes_cache: Mutex<Option<(Instant, String)>>,
|
||||
/// Opens bug reports as GitHub issues; None without a token.
|
||||
filer: Option<Arc<Filer>>,
|
||||
}
|
||||
|
||||
type Buckets = HashMap<IpAddr, (f64, Instant)>;
|
||||
@@ -145,6 +210,20 @@ impl App {
|
||||
store: Store,
|
||||
config: Config,
|
||||
today: Box<dyn Fn() -> u32 + Send + Sync>,
|
||||
) -> Arc<Self> {
|
||||
let filer = config
|
||||
.github_token
|
||||
.clone()
|
||||
.map(|token| Arc::from(github::github(config.github_repo.clone(), token)));
|
||||
Self::with_filer(store, config, today, filer)
|
||||
}
|
||||
|
||||
/// [`Self::with_clock`] with the hub's bug reports opened by `filer` (tests give their own).
|
||||
pub fn with_filer(
|
||||
store: Store,
|
||||
config: Config,
|
||||
today: Box<dyn Fn() -> u32 + Send + Sync>,
|
||||
filer: Option<Arc<Filer>>,
|
||||
) -> Arc<Self> {
|
||||
let live = Live::new(config.live_window, config.live_max_sessions);
|
||||
Arc::new(Self {
|
||||
@@ -157,6 +236,11 @@ impl App {
|
||||
cache: Mutex::default(),
|
||||
summary_cache: Mutex::default(),
|
||||
today,
|
||||
hub_key: RandomState::new(),
|
||||
hub_buckets: Mutex::default(),
|
||||
hub_post_buckets: Mutex::default(),
|
||||
votes_cache: Mutex::default(),
|
||||
filer,
|
||||
})
|
||||
}
|
||||
|
||||
@@ -217,10 +301,13 @@ impl App {
|
||||
}
|
||||
|
||||
/// Daily upkeep: totals rebuilt, expired rows removed, idle rate-limit entries and live
|
||||
/// sessions forgotten.
|
||||
/// sessions forgotten, the hub's old reports and suggestions removed. Reports still waiting for
|
||||
/// their issue are [`Self::file_pending`]'s.
|
||||
pub fn maintain(&self) -> rusqlite::Result<usize> {
|
||||
let oldest = (self.today)().saturating_sub(self.config.retention_days);
|
||||
let removed = self.store().expire(oldest)?;
|
||||
self.expire_intake()?;
|
||||
self.forget_hub_buckets();
|
||||
for buckets in [&self.buckets, &self.live_buckets] {
|
||||
buckets
|
||||
.lock()
|
||||
@@ -235,14 +322,14 @@ impl App {
|
||||
}
|
||||
}
|
||||
|
||||
/// Takes a token for `ip` from its bucket in `buckets` (`per_hour`, bursts of a tenth of it);
|
||||
/// Takes a token for `key` from its bucket in `buckets` (`per_hour`, bursts of a tenth of it);
|
||||
/// false when it has none left.
|
||||
fn take(buckets: &Mutex<Buckets>, per_hour: f64, ip: IpAddr) -> bool {
|
||||
fn take<K: Hash + Eq>(buckets: &Mutex<HashMap<K, (f64, Instant)>>, per_hour: f64, key: K) -> bool {
|
||||
let rate = per_hour / 3600.0;
|
||||
let burst = (per_hour / 10.0).max(1.0);
|
||||
let mut buckets = buckets.lock().unwrap_or_else(|e| e.into_inner());
|
||||
let now = Instant::now();
|
||||
let (tokens, at) = buckets.entry(ip).or_insert((burst, now));
|
||||
let (tokens, at) = buckets.entry(key).or_insert((burst, now));
|
||||
*tokens = (*tokens + now.duration_since(*at).as_secs_f64() * rate).min(burst);
|
||||
*at = now;
|
||||
if *tokens < 1.0 {
|
||||
@@ -482,6 +569,14 @@ pub fn router(app: Arc<App>) -> Router {
|
||||
.route("/v1/installs/{id}", delete(forget))
|
||||
.route("/v1/aggregate", get(aggregate))
|
||||
.route("/v1/benchmarks/summary", get(benchmarks))
|
||||
.route("/hub/vote", post(hub::vote).options(hub::preflight))
|
||||
.route("/hub/votes", get(hub::votes))
|
||||
.route("/hub/report", post(intake::report).options(hub::preflight))
|
||||
.route(
|
||||
"/hub/suggest",
|
||||
post(intake::suggest).options(hub::preflight),
|
||||
)
|
||||
.route("/hub/suggestions", get(intake::suggestions))
|
||||
.route("/healthz", get(|| async { "ok" }))
|
||||
.with_state(app)
|
||||
}
|
||||
|
||||
@@ -22,6 +22,9 @@ async fn main() {
|
||||
if let Err(e) = upkeep.maintain() {
|
||||
eprintln!("horizon-telemetry-server: upkeep failed: {e}");
|
||||
}
|
||||
// The hub's reports GitHub refused before: their issues, off the async workers.
|
||||
let filing = upkeep.clone();
|
||||
let _ = tokio::task::spawn_blocking(move || filing.file_pending()).await;
|
||||
}
|
||||
});
|
||||
let listener = tokio::net::TcpListener::bind(SocketAddr::from(([0, 0, 0, 0], port)))
|
||||
|
||||
@@ -123,13 +123,15 @@ pub fn gpu_vendor(gpu: &str) -> &'static str {
|
||||
}
|
||||
|
||||
pub struct Store {
|
||||
db: Connection,
|
||||
pub(crate) db: Connection,
|
||||
}
|
||||
|
||||
impl Store {
|
||||
pub fn open(path: &str) -> rusqlite::Result<Self> {
|
||||
let mut db = Connection::open(path)?;
|
||||
db.execute_batch(SCHEMA)?;
|
||||
db.execute_batch(crate::hub::SCHEMA)?;
|
||||
db.execute_batch(crate::intake::SCHEMA)?;
|
||||
migrate(&mut db)?;
|
||||
Ok(Self { db })
|
||||
}
|
||||
|
||||
@@ -0,0 +1,41 @@
|
||||
//! A website bug report as the issue GitHub gets: the template, and people's text made inert.
|
||||
use horizon_telemetry_server::github::{issue, neutralise};
|
||||
use serde_json::{Map, Value, json};
|
||||
|
||||
#[test]
|
||||
fn people_text_mentions_and_references_nothing() {
|
||||
let text =
|
||||
neutralise("@octocat see #12 and https://github.com/a/b/issues/3 <img src=x> `x` Fixes it");
|
||||
assert!(!text.contains("@o") && !text.contains("#1") && !text.contains("github.com/"));
|
||||
assert!(!text.contains('<') && !text.contains('`'));
|
||||
assert!(text.contains("F\u{200b}ixes"));
|
||||
// Words that only start like a keyword stay as they are.
|
||||
assert_eq!(neutralise("closet fixture"), "closet fixture");
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn a_report_reads_as_the_template() {
|
||||
let fields: Map<String, Value> = serde_json::from_value(json!({
|
||||
"title": "Water is black\non AMD", "did": "Opened a world", "happened": "Black water",
|
||||
"expected": "Blue water", "system": "Windows 11, RX 6600", "name": "steve_"
|
||||
}))
|
||||
.unwrap();
|
||||
let issue = issue(&fields);
|
||||
assert_eq!(issue.title, "Water is black on AMD");
|
||||
assert!(
|
||||
issue
|
||||
.body
|
||||
.starts_with("> **What I did:**\n> Opened a world\n> **What happened:**")
|
||||
);
|
||||
assert!(
|
||||
issue
|
||||
.body
|
||||
.contains("> **Horizon version:** not given\n> **OS, CPU, GPU:** Windows 11, RX 6600")
|
||||
);
|
||||
assert!(
|
||||
issue
|
||||
.body
|
||||
.contains("Reported on playhorizon.dev by **steve**")
|
||||
);
|
||||
assert_eq!(issue.labels, ["bug", "from-website"]);
|
||||
}
|
||||
@@ -0,0 +1,398 @@
|
||||
//! The hub's intake through its HTTP interface: votes, bug reports (opened as issues by a fake GitHub),
|
||||
//! suggestions and the queue Kira reads.
|
||||
use std::sync::atomic::{AtomicU32, Ordering};
|
||||
use std::sync::{Arc, Mutex};
|
||||
|
||||
use axum::body::Body;
|
||||
use axum::http::{Request, StatusCode};
|
||||
use horizon_telemetry_server::github::{Filer, Issue};
|
||||
use horizon_telemetry_server::store::Store;
|
||||
use horizon_telemetry_server::{App, Config, router};
|
||||
use http_body_util::BodyExt;
|
||||
use serde_json::{Value, json};
|
||||
use tower::ServiceExt;
|
||||
|
||||
const DAY: u32 = 20_741;
|
||||
const VOTER: &str = "0b7c3c9e-3f0a-4d8e-9a39-4c1f5a6b7d21";
|
||||
|
||||
/// The issues the fake GitHub opened, and whether it is up.
|
||||
#[derive(Default)]
|
||||
struct GitHub {
|
||||
opened: Mutex<Vec<Issue>>,
|
||||
down: Mutex<bool>,
|
||||
}
|
||||
|
||||
struct Hub {
|
||||
app: Arc<App>,
|
||||
github: Arc<GitHub>,
|
||||
day: Arc<AtomicU32>,
|
||||
}
|
||||
|
||||
fn hub(config: Config) -> Hub {
|
||||
let github = Arc::new(GitHub::default());
|
||||
let fake = github.clone();
|
||||
let filer: Arc<Filer> = Arc::new(move |issue: &Issue| {
|
||||
if *fake.down.lock().unwrap() {
|
||||
return Err("GitHub answered 502".into());
|
||||
}
|
||||
let mut opened = fake.opened.lock().unwrap();
|
||||
opened.push(Issue {
|
||||
title: issue.title.clone(),
|
||||
body: issue.body.clone(),
|
||||
labels: issue.labels.clone(),
|
||||
});
|
||||
Ok(format!(
|
||||
"https://github.com/ludovic111/horizon/issues/{}",
|
||||
1000 + opened.len()
|
||||
))
|
||||
});
|
||||
let day = Arc::new(AtomicU32::new(DAY));
|
||||
let clock = day.clone();
|
||||
let app = App::with_filer(
|
||||
Store::open(":memory:").unwrap(),
|
||||
config,
|
||||
Box::new(move || clock.load(Ordering::SeqCst)),
|
||||
Some(filer),
|
||||
);
|
||||
Hub { app, github, day }
|
||||
}
|
||||
|
||||
fn config() -> Config {
|
||||
Config {
|
||||
hub_token: Some("kira-secret".into()),
|
||||
hub_posts_per_hour: 1000.0,
|
||||
..Config::default()
|
||||
}
|
||||
}
|
||||
|
||||
impl Hub {
|
||||
async fn send(&self, req: Request<Body>) -> (StatusCode, Value) {
|
||||
let res = router(self.app.clone()).oneshot(req).await.unwrap();
|
||||
let code = res.status();
|
||||
let body = res.into_body().collect().await.unwrap().to_bytes();
|
||||
(code, serde_json::from_slice(&body).unwrap_or(Value::Null))
|
||||
}
|
||||
|
||||
async fn post(&self, path: &str, body: Value) -> (StatusCode, Value) {
|
||||
self.send(
|
||||
Request::post(path)
|
||||
.header("content-type", "application/json")
|
||||
.body(Body::from(body.to_string()))
|
||||
.unwrap(),
|
||||
)
|
||||
.await
|
||||
}
|
||||
|
||||
async fn get(&self, path: &str, token: Option<&str>) -> (StatusCode, Value) {
|
||||
let mut req = Request::get(path);
|
||||
if let Some(token) = token {
|
||||
req = req.header("authorization", format!("Bearer {token}"));
|
||||
}
|
||||
self.send(req.body(Body::empty()).unwrap()).await
|
||||
}
|
||||
}
|
||||
|
||||
fn report(title: &str) -> Value {
|
||||
json!({
|
||||
"title": title,
|
||||
"did": "Opened a new world\nWalked to the sea",
|
||||
"happened": "The water is black",
|
||||
"expected": "Blue water, as in vanilla",
|
||||
"version": "v0.2.57",
|
||||
"system": "Windows 11, Ryzen 5 5600, RX 6600",
|
||||
"website": "",
|
||||
})
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn votes_count_once_per_browser_and_can_be_taken_back() {
|
||||
let hub = hub(config());
|
||||
let vote = |up: bool, voter: &str| json!({ "item": "smooth-frames", "voter": voter, "up": up });
|
||||
assert_eq!(
|
||||
hub.post("/hub/vote", vote(true, VOTER)).await,
|
||||
(
|
||||
StatusCode::OK,
|
||||
json!({ "item": "smooth-frames", "votes": 1 })
|
||||
)
|
||||
);
|
||||
assert_eq!(
|
||||
hub.post("/hub/vote", vote(true, VOTER)).await.1["votes"],
|
||||
1,
|
||||
"a second vote changes nothing"
|
||||
);
|
||||
let other = "f".repeat(32);
|
||||
assert_eq!(
|
||||
hub.post("/hub/vote", vote(true, &other)).await.1["votes"],
|
||||
2
|
||||
);
|
||||
assert_eq!(
|
||||
hub.get("/hub/votes", None).await,
|
||||
(StatusCode::OK, json!({ "votes": { "smooth-frames": 2 } }))
|
||||
);
|
||||
assert_eq!(
|
||||
hub.post("/hub/vote", vote(false, VOTER)).await.1["votes"],
|
||||
1
|
||||
);
|
||||
assert_eq!(
|
||||
hub.get("/hub/votes", None).await.1["votes"]["smooth-frames"],
|
||||
1,
|
||||
"a vote drops the cached counts"
|
||||
);
|
||||
for bad in [
|
||||
json!({ "item": "Not An Id", "voter": VOTER }),
|
||||
json!({ "item": "a", "voter": "short" }),
|
||||
json!([]),
|
||||
] {
|
||||
assert_eq!(hub.post("/hub/vote", bad).await.0, StatusCode::BAD_REQUEST);
|
||||
}
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn a_report_becomes_an_issue_in_the_bug_template() {
|
||||
let hub = hub(config());
|
||||
let (code, body) = hub
|
||||
.post("/hub/report", report("Water is black on AMD"))
|
||||
.await;
|
||||
assert_eq!(code, StatusCode::CREATED);
|
||||
assert_eq!(
|
||||
body["issue"],
|
||||
"https://github.com/ludovic111/horizon/issues/1001"
|
||||
);
|
||||
let issue = hub.github.opened.lock().unwrap().remove(0);
|
||||
assert_eq!(issue.title, "Water is black on AMD");
|
||||
assert_eq!(issue.labels, ["bug", "from-website"]);
|
||||
for line in [
|
||||
"> **What I did:**\n> Opened a new world\n> Walked to the sea",
|
||||
"> **What happened:**\n> The water is black",
|
||||
"> **What I expected:**\n> Blue water, as in vanilla",
|
||||
"> **Horizon version:** v0.2.57",
|
||||
"> **OS, CPU, GPU:** Windows 11, Ryzen 5 5600, RX 6600",
|
||||
"Reported on playhorizon.dev",
|
||||
] {
|
||||
assert!(issue.body.contains(line), "{line}\n---\n{}", issue.body);
|
||||
}
|
||||
// The same report again (a double click) answers the same issue and opens nothing.
|
||||
let (code, again) = hub
|
||||
.post("/hub/report", report("Water is black on AMD"))
|
||||
.await;
|
||||
assert_eq!(
|
||||
(code, &again["issue"]),
|
||||
(StatusCode::CREATED, &body["issue"])
|
||||
);
|
||||
assert!(hub.github.opened.lock().unwrap().is_empty());
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn reports_need_every_template_field_and_skip_bots() {
|
||||
let hub = hub(config());
|
||||
for empty in ["title", "did", "happened", "expected", "system"] {
|
||||
let mut body = report("Water is black on AMD");
|
||||
body[empty] = json!(" ");
|
||||
let (code, answer) = hub.post("/hub/report", body).await;
|
||||
assert_eq!(code, StatusCode::BAD_REQUEST, "{empty}");
|
||||
assert!(answer["error"].as_str().unwrap().starts_with(empty));
|
||||
}
|
||||
let mut bot = report("Cheap watches");
|
||||
bot["website"] = json!("https://spam.example");
|
||||
assert_eq!(
|
||||
hub.post("/hub/report", bot).await,
|
||||
(StatusCode::ACCEPTED, json!({ "id": 0 }))
|
||||
);
|
||||
assert!(hub.github.opened.lock().unwrap().is_empty());
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn a_report_github_refused_is_opened_by_the_upkeep() {
|
||||
let hub = hub(config());
|
||||
*hub.github.down.lock().unwrap() = true;
|
||||
let (code, body) = hub
|
||||
.post("/hub/report", report("Crash when opening a chest"))
|
||||
.await;
|
||||
assert_eq!((code, &body["issue"]), (StatusCode::ACCEPTED, &Value::Null));
|
||||
hub.app.file_pending();
|
||||
assert_eq!(hub.github.opened.lock().unwrap().len(), 0);
|
||||
*hub.github.down.lock().unwrap() = false;
|
||||
hub.app.file_pending();
|
||||
assert_eq!(hub.github.opened.lock().unwrap().len(), 1);
|
||||
hub.app.file_pending();
|
||||
assert_eq!(hub.github.opened.lock().unwrap().len(), 1, "opened once");
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn reports_are_closed_without_a_github_token() {
|
||||
let app = App::with_clock(
|
||||
Store::open(":memory:").unwrap(),
|
||||
Config::default(),
|
||||
Box::new(|| DAY),
|
||||
);
|
||||
let res = router(app)
|
||||
.oneshot(
|
||||
Request::post("/hub/report")
|
||||
.header("content-type", "application/json")
|
||||
.body(Body::from(report("Water is black").to_string()))
|
||||
.unwrap(),
|
||||
)
|
||||
.await
|
||||
.unwrap();
|
||||
assert_eq!(res.status(), StatusCode::SERVICE_UNAVAILABLE);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn suggestions_wait_in_the_queue_for_kira() {
|
||||
let hub = hub(config());
|
||||
let first = json!({ "text": " Add a waypoint mod\r\nto the\u{7} browser ", "item": "mod-registry", "name": "alex", "extra": 1 });
|
||||
let (code, body) = hub.post("/hub/suggest", first).await;
|
||||
assert_eq!(code, StatusCode::ACCEPTED);
|
||||
let first_id = body["id"].as_i64().unwrap();
|
||||
hub.post(
|
||||
"/hub/suggest",
|
||||
json!({ "text": "Bigger render distance on the Steam Deck" }),
|
||||
)
|
||||
.await;
|
||||
assert_eq!(
|
||||
hub.post("/hub/suggest", json!({ "text": "too short" }))
|
||||
.await
|
||||
.0,
|
||||
StatusCode::BAD_REQUEST
|
||||
);
|
||||
assert_eq!(
|
||||
hub.post(
|
||||
"/hub/suggest",
|
||||
json!({ "text": "A long enough idea", "item": "Bad Id" })
|
||||
)
|
||||
.await
|
||||
.0,
|
||||
StatusCode::BAD_REQUEST
|
||||
);
|
||||
|
||||
assert_eq!(
|
||||
hub.get("/hub/suggestions", None).await.0,
|
||||
StatusCode::UNAUTHORIZED
|
||||
);
|
||||
assert_eq!(
|
||||
hub.get("/hub/suggestions", Some("wrong-secret")).await.0,
|
||||
StatusCode::UNAUTHORIZED
|
||||
);
|
||||
let (code, all) = hub.get("/hub/suggestions", Some("kira-secret")).await;
|
||||
assert_eq!(code, StatusCode::OK);
|
||||
let list = all["suggestions"].as_array().unwrap();
|
||||
assert_eq!(list.len(), 2);
|
||||
assert_eq!(
|
||||
list[0]["text"], "Add a waypoint mod\nto the browser",
|
||||
"trimmed, no control characters"
|
||||
);
|
||||
assert!(list[0].get("extra").is_none());
|
||||
assert_eq!(list[0]["item"], "mod-registry");
|
||||
assert_eq!(list[0]["name"], "alex");
|
||||
assert!(list[0]["created_at"].as_str().unwrap().ends_with('Z'));
|
||||
assert!(list[1].get("name").is_none());
|
||||
let (_, after) = hub
|
||||
.get(
|
||||
&format!("/hub/suggestions?after={first_id}"),
|
||||
Some("kira-secret"),
|
||||
)
|
||||
.await;
|
||||
assert_eq!(after["suggestions"].as_array().unwrap().len(), 1);
|
||||
|
||||
let closed = hub_without_token();
|
||||
assert_eq!(
|
||||
closed.get("/hub/suggestions", Some("anything")).await.0,
|
||||
StatusCode::NOT_FOUND
|
||||
);
|
||||
}
|
||||
|
||||
fn hub_without_token() -> Hub {
|
||||
hub(Config::default())
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn posts_are_rate_limited_per_address_and_capped_per_day() {
|
||||
let hub = hub(Config {
|
||||
hub_posts_per_hour: 20.0,
|
||||
hub_suggestions_per_day: 3,
|
||||
..config()
|
||||
});
|
||||
// A burst of a tenth of the hourly rate: two, then refused.
|
||||
let idea = |n: u32| json!({ "text": format!("Idea number {n}, long enough") });
|
||||
assert_eq!(
|
||||
hub.post("/hub/suggest", idea(1)).await.0,
|
||||
StatusCode::ACCEPTED
|
||||
);
|
||||
assert_eq!(
|
||||
hub.post("/hub/suggest", idea(2)).await.0,
|
||||
StatusCode::ACCEPTED
|
||||
);
|
||||
assert_eq!(
|
||||
hub.post("/hub/suggest", idea(3)).await.0,
|
||||
StatusCode::TOO_MANY_REQUESTS
|
||||
);
|
||||
|
||||
let busy = self::hub(Config {
|
||||
hub_posts_per_hour: 1000.0,
|
||||
hub_suggestions_per_day: 3,
|
||||
..config()
|
||||
});
|
||||
for n in 0..3 {
|
||||
assert_eq!(
|
||||
busy.post("/hub/suggest", idea(n)).await.0,
|
||||
StatusCode::ACCEPTED
|
||||
);
|
||||
}
|
||||
assert_eq!(
|
||||
busy.post("/hub/suggest", idea(9)).await.0,
|
||||
StatusCode::SERVICE_UNAVAILABLE
|
||||
);
|
||||
busy.day.store(DAY + 1, Ordering::SeqCst);
|
||||
assert_eq!(
|
||||
busy.post("/hub/suggest", idea(9)).await.0,
|
||||
StatusCode::ACCEPTED,
|
||||
"a new day"
|
||||
);
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn old_entries_go_and_reports_never_opened_are_given_up() {
|
||||
let hub = hub(config());
|
||||
*hub.github.down.lock().unwrap() = true;
|
||||
let (_, body) = hub
|
||||
.post("/hub/report", report("Crash when opening a chest"))
|
||||
.await;
|
||||
assert!(body["id"].as_i64().unwrap() > 0);
|
||||
hub.post("/hub/suggest", json!({ "text": "An idea from long ago" }))
|
||||
.await;
|
||||
hub.day.store(DAY + 8, Ordering::SeqCst);
|
||||
hub.app.maintain().unwrap();
|
||||
*hub.github.down.lock().unwrap() = false;
|
||||
hub.app.file_pending();
|
||||
assert!(
|
||||
hub.github.opened.lock().unwrap().is_empty(),
|
||||
"past a week a report is given up"
|
||||
);
|
||||
hub.day.store(DAY + 91, Ordering::SeqCst);
|
||||
hub.app.maintain().unwrap();
|
||||
let (_, left) = hub.get("/hub/suggestions", Some("kira-secret")).await;
|
||||
assert!(left["suggestions"].as_array().unwrap().is_empty());
|
||||
}
|
||||
|
||||
#[tokio::test]
|
||||
async fn the_website_may_post_from_the_browser() {
|
||||
let hub = hub(config());
|
||||
let res = router(hub.app.clone())
|
||||
.oneshot(
|
||||
Request::options("/hub/report")
|
||||
.header("origin", "https://playhorizon.dev")
|
||||
.header("access-control-request-method", "POST")
|
||||
.body(Body::empty())
|
||||
.unwrap(),
|
||||
)
|
||||
.await
|
||||
.unwrap();
|
||||
assert_eq!(res.status(), StatusCode::NO_CONTENT);
|
||||
let header = |name: &str| res.headers()[name].to_str().unwrap().to_owned();
|
||||
assert_eq!(
|
||||
header("access-control-allow-origin"),
|
||||
"https://playhorizon.dev"
|
||||
);
|
||||
assert_eq!(header("access-control-allow-methods"), "POST");
|
||||
assert_eq!(header("access-control-allow-headers"), "content-type");
|
||||
}
|
||||
+1
-1
@@ -1,6 +1,6 @@
|
||||
# Horizon documentation
|
||||
|
||||
To play, use [the launcher](../launcher/README.md); the project site is [playhorizon.dev](https://playhorizon.dev). These pages are for developers.
|
||||
To play, use [the launcher](../launcher/README.md); the project site is [playhorizon.dev](https://playhorizon.dev). These pages are for developers. What is being done now and next, the work board and how to help: [the hub](https://playhorizon.dev/hub) ([ROADMAP.md](../ROADMAP.md), [roadmap/README.md](../roadmap/README.md) for keeping it current).
|
||||
|
||||
## Build and run
|
||||
|
||||
|
||||
+2
-1
@@ -51,5 +51,6 @@ Every page has the same parts: **Overview** (what you can build), **Guide** (whe
|
||||
**Examples**, **Stability** (the level of each part, per [stability.md](stability.md)), **Changelog** and
|
||||
**Not there yet** (what is planned, so nobody builds on a guess).
|
||||
|
||||
The website's summary for players and authors is [playhorizon.dev/docs/apis](https://playhorizon.dev/docs/apis)
|
||||
The website shows these pages at [playhorizon.dev/docs/api](https://playhorizon.dev/docs/api), built from this
|
||||
folder, and a summary for players and authors at [playhorizon.dev/docs/apis](https://playhorizon.dev/docs/apis)
|
||||
(`website/docs/apis.md`).
|
||||
|
||||
+5
-1
@@ -19,11 +19,14 @@ the player before the mod is turned on, and checked against the component's real
|
||||
| Capabilities | 5: `game-read`, `chat`, `hud`, `storage`, `registries` |
|
||||
| Manifest `api` lines served | 2: `0.1` (code), `0.2` (content) |
|
||||
| SDK | the `Mod` trait (5 methods), `Registration` (4 builders), `export_mod!`, log helpers |
|
||||
| `cargo horizon-mod` | `new`, `build`, `run` |
|
||||
| `cargo horizon-mod` | `new` (templates `code` and `content`), `build`, `run`, `check` |
|
||||
| Example mods | `coords-hud` (code), `ruby-content` (content) |
|
||||
|
||||
## Guide
|
||||
|
||||
The step-by-step guide, from installing the tools to publishing on the registry, is
|
||||
[Make a mod](https://playhorizon.dev/docs/make-a-mod) on the website. In short:
|
||||
|
||||
1. `rustup target add wasm32-unknown-unknown`, `cargo install --git https://github.com/ludovic111/horizon
|
||||
cargo-horizon-mod`, then `cargo horizon-mod new my-mod` ([Making a mod](../mods.md#making-a-mod)).
|
||||
2. Implement `Mod` for your type, list the capabilities you import in `horizon-mod.toml`
|
||||
@@ -55,6 +58,7 @@ scripting runtime in the game.
|
||||
| Way in | For | Status | Template and example |
|
||||
| --- | --- | --- | --- |
|
||||
| Rust | most mods; the fastest | first-class: the SDK, `cargo horizon-mod` | `cargo horizon-mod new`, `coords-hud` |
|
||||
| Data only | blocks and items with no code | first-class: content mods (API 0.2) | `cargo horizon-mod new --template content`, `ruby-content` |
|
||||
| Lua scripts | people who don't want a compiler | planned: a script mod whose code is a `.lua` file, run by Horizon's own interpreter mod | planned, with the same example as Rust |
|
||||
| C, C++, Zig | authors of those languages | to evaluate: bindings generated from the WIT, built without WASI | one each if it passes |
|
||||
| Go (TinyGo), AssemblyScript, JavaScript / TypeScript | authors of those languages | to evaluate: each needs its toolchain to emit a component without WASI imports, or an interpreter mod as for Lua | one each if it passes |
|
||||
|
||||
+6
-2
@@ -16,7 +16,7 @@ folder, loads no runtime and plays exactly like vanilla 26.3.
|
||||
| SDK for mod authors | `crates/horizon-mod-sdk` | 0.1 |
|
||||
| Example mod | `crates/horizon-mod-sdk/examples/coords-hud` | coordinates, facing and time HUD, `/where`, `/coords` |
|
||||
| Runtime | `crates/horizon-mods` | wasmtime 36 LTS, component model |
|
||||
| Authoring tool | `crates/cargo-horizon-mod` | `cargo horizon-mod new / build / run / check`, and the registry's CI (`registry build / review / list`) |
|
||||
| Authoring tool | `crates/cargo-horizon-mod` | `cargo horizon-mod new [--template code\|content] / build / run / check`, and the registry's CI (`registry build / review / list`) |
|
||||
| In the game | `crates/horizon-client/src/game/mods.rs`, Options > Mods | client mods |
|
||||
| Launcher mod browser (Modrinth, CurseForge with a key) | [mod-browser.md](mod-browser.md) | resource packs, modpacks |
|
||||
| Registry index (`index.json`, `.hpack`), signatures | `horizon_mods::index`, [api/mod-index.md](api/mod-index.md) | schema 1; launcher and website next |
|
||||
@@ -215,6 +215,7 @@ Benchmarks (`--benchmark`) never load mods.
|
||||
rustup target add wasm32-unknown-unknown
|
||||
cargo install --git https://github.com/ludovic111/horizon cargo-horizon-mod
|
||||
cargo horizon-mod new my-mod # Cargo.toml, horizon-mod.toml, src/lib.rs
|
||||
# (--template content: a content mod, no code)
|
||||
cd my-mod
|
||||
cargo horizon-mod run # build, then start the game with it
|
||||
cargo horizon-mod build # again after an edit: the running game reloads it
|
||||
@@ -292,7 +293,10 @@ permission.
|
||||
### Content mods (API 0.2)
|
||||
|
||||
A mod with `api = "0.2"` and capability `registries` may carry `assets/` and
|
||||
`data/` in the `.hmod`, and needs no `mod.wasm` if it has no code. It adds
|
||||
`data/` in the `.hmod`, and needs no `mod.wasm` if it has no code
|
||||
(`cargo horizon-mod new --template content` starts one; `build` in a folder
|
||||
with no `Cargo.toml` packs the manifest, `assets/` and `data/`, and `check`
|
||||
reads it without a trial run). It adds
|
||||
blocks and items by declaring them in `data/<id>/horizon/block/*.json` and
|
||||
`data/<id>/horizon/item/*.json`, each copying a vanilla template
|
||||
([modpacks.md](modpacks.md#registries-02-data-driven-blocks-and-items)):
|
||||
|
||||
Generated
+2
@@ -2681,8 +2681,10 @@ dependencies = [
|
||||
"horizon-theme",
|
||||
"image",
|
||||
"keyring",
|
||||
"objc2-app-kit",
|
||||
"oo7",
|
||||
"pulldown-cmark",
|
||||
"raw-window-handle",
|
||||
"self-replace",
|
||||
"serde",
|
||||
"serde_json",
|
||||
|
||||
@@ -50,6 +50,10 @@ oo7 = { version = "0.5", default-features = false, features = ["async-std", "nat
|
||||
futures-lite = "2"
|
||||
[target.'cfg(target_os = "macos")'.dependencies]
|
||||
keyring = { version = "3", features = ["apple-native"] }
|
||||
# Painting the window's title bar dark or light (titlebar::apply_appearance): crates already in
|
||||
# the lockfile through gpui and wgpu.
|
||||
objc2-app-kit = { version = "0.3", default-features = false, features = ["NSAppearance", "NSView", "NSWindow"] }
|
||||
raw-window-handle = "0.6"
|
||||
[target.'cfg(target_os = "windows")'.dependencies]
|
||||
keyring = { version = "3", features = ["windows-native"] }
|
||||
|
||||
|
||||
@@ -190,6 +190,18 @@ fn version_of(index: &Index, p: &index::Project, v: &index::Version) -> Version
|
||||
}
|
||||
}
|
||||
|
||||
/// A GitHub login as GitHub allows it (letters, digits, single dashes, at most 39), so an index
|
||||
/// entry can't turn a link into something else.
|
||||
fn github_login(login: &str) -> bool {
|
||||
(1..=39).contains(&login.len())
|
||||
&& login
|
||||
.bytes()
|
||||
.all(|b| b.is_ascii_alphanumeric() || b == b'-')
|
||||
&& !login.starts_with('-')
|
||||
&& !login.ends_with('-')
|
||||
&& !login.contains("--")
|
||||
}
|
||||
|
||||
/// The words of a query found in a project's id, name, summary or authors.
|
||||
fn matches(p: &index::Project, text: &str) -> bool {
|
||||
let hay = format!("{} {} {} {}", p.id, p.name, p.summary, p.authors.join(" ")).to_lowercase();
|
||||
@@ -277,9 +289,14 @@ impl Source for Registry {
|
||||
body.push_str(&format!("- {} {}{may}\n", m.name, w.version));
|
||||
}
|
||||
}
|
||||
// Who publishes it: the GitHub accounts the registry checked at submission.
|
||||
let owners = p.owners.iter().filter(|o| github_login(o)).map(|o| Link {
|
||||
label: format!("@{o}"),
|
||||
url: format!("https://github.com/{o}"),
|
||||
});
|
||||
Ok(Details {
|
||||
body,
|
||||
links: vec![
|
||||
links: [
|
||||
Link {
|
||||
label: "Source".into(),
|
||||
url: p.source.clone(),
|
||||
@@ -292,7 +309,10 @@ impl Source for Registry {
|
||||
label: "Report".into(),
|
||||
url: format!("{REPORT}&title={}", p.id),
|
||||
},
|
||||
],
|
||||
]
|
||||
.into_iter()
|
||||
.chain(owners)
|
||||
.collect(),
|
||||
authors: p.authors.clone(),
|
||||
published: p
|
||||
.versions
|
||||
@@ -323,6 +343,7 @@ fn fetch(
|
||||
) -> Result<PathBuf, String> {
|
||||
match file.url.strip_prefix("file://").filter(|_| local) {
|
||||
Some(path) => {
|
||||
let path = local_path(path);
|
||||
let reader = fs::File::open(path).map_err(|e| format!("{path}: {e}"))?;
|
||||
download::save_from_anywhere(file, reader, folder, progress)
|
||||
}
|
||||
@@ -330,6 +351,14 @@ fn fetch(
|
||||
}
|
||||
}
|
||||
|
||||
/// The path of a `file:///` URL: on Windows `/C:/x` is `C:/x`.
|
||||
fn local_path(path: &str) -> &str {
|
||||
match path.strip_prefix('/') {
|
||||
Some(rest) if cfg!(windows) && rest.get(1..2) == Some(":") => rest,
|
||||
_ => path,
|
||||
}
|
||||
}
|
||||
|
||||
/// What the registry adds to an installed entry.
|
||||
fn trust_label(trust: Trust) -> &'static str {
|
||||
match trust {
|
||||
|
||||
@@ -208,6 +208,16 @@ mod tests {
|
||||
zip.write_all(b"renderDistance:8\n").unwrap();
|
||||
zip.finish().unwrap();
|
||||
let size = |p: &Path| fs::metadata(p).unwrap().len();
|
||||
// A `file:///` URL: forward slashes (a Windows path's backslashes would be escapes in
|
||||
// the JSON) and a leading slash before a Windows drive.
|
||||
let url = |p: &Path| {
|
||||
let path = p.display().to_string().replace('\\', "/");
|
||||
if path.starts_with('/') {
|
||||
path
|
||||
} else {
|
||||
format!("/{path}")
|
||||
}
|
||||
};
|
||||
let text = format!(
|
||||
r#"{{"schema": 1, "projects": [
|
||||
{{"id": "coords_hud", "kind": "mod", "name": "Coordinates HUD", "summary": "", "license": "MIT",
|
||||
@@ -219,9 +229,9 @@ mod tests {
|
||||
"requires": [{{"id": "coords_hud", "version": "0.1.0", "sha256": "{hmod_sha}"}}],
|
||||
"file": {{"name": "cozy-1.0.0.hpack", "url": "file://{}", "size": {}, "sha256": "{}"}}}}]}}
|
||||
]{extra}}}"#,
|
||||
hmod.display(),
|
||||
url(&hmod),
|
||||
size(&hmod),
|
||||
hpack.display(),
|
||||
url(&hpack),
|
||||
size(&hpack),
|
||||
idx::sha256_file(&hpack).unwrap()
|
||||
);
|
||||
|
||||
@@ -143,3 +143,22 @@ fn registry_versions_run_when_made_for_this_game() {
|
||||
.collect();
|
||||
assert_eq!(pick(Kind::Mod, &versions, false).unwrap().number, "0.1.0");
|
||||
}
|
||||
|
||||
#[test]
|
||||
fn owner_links_only_take_github_logins() {
|
||||
for ok in ["Stink-O", "ludovic111", "a"] {
|
||||
assert!(github_login(ok), "{ok}");
|
||||
}
|
||||
for bad in [
|
||||
"",
|
||||
"-x",
|
||||
"x-",
|
||||
"a--b",
|
||||
"bad login",
|
||||
"a/b",
|
||||
"x?y=1",
|
||||
&"a".repeat(40),
|
||||
] {
|
||||
assert!(!github_login(bad), "{bad}");
|
||||
}
|
||||
}
|
||||
|
||||
@@ -267,6 +267,9 @@ impl Launcher {
|
||||
{
|
||||
settings.selected = installed.first().cloned();
|
||||
}
|
||||
// Pin the window's chrome (macOS title bar) to the choice before the theme reads
|
||||
// `window.appearance()`, so both draw the same look.
|
||||
titlebar::apply_appearance(window, settings.appearance);
|
||||
let mut this = Self {
|
||||
theme: Theme::for_appearance(settings.appearance, window.appearance()),
|
||||
page: Page::from_env(),
|
||||
@@ -2485,6 +2488,7 @@ impl Launcher {
|
||||
let _ = this.update(cx, |this, cx| {
|
||||
this.settings.appearance = choice;
|
||||
this.settings.save();
|
||||
titlebar::apply_appearance(window, choice);
|
||||
this.theme = Theme::for_appearance(choice, window.appearance());
|
||||
cx.notify();
|
||||
});
|
||||
|
||||
+25
-14
@@ -74,22 +74,33 @@ fn c(hex: u32) -> Hsla {
|
||||
rgb(hex).into()
|
||||
}
|
||||
|
||||
/// Whether the launcher is pinned dark (`Some(true)`) or light, or follows the system (`None`):
|
||||
/// `HORIZON_LAUNCHER_APPEARANCE=light` or `dark` (for screenshots and tests), else the player's
|
||||
/// choice in Settings.
|
||||
pub fn pinned_dark(choice: Appearance) -> Option<bool> {
|
||||
match std::env::var("HORIZON_LAUNCHER_APPEARANCE").as_deref() {
|
||||
Ok("light") => Some(false),
|
||||
Ok("dark") => Some(true),
|
||||
_ => match choice {
|
||||
Appearance::Dark => Some(true),
|
||||
Appearance::Light => Some(false),
|
||||
Appearance::System => None,
|
||||
},
|
||||
}
|
||||
}
|
||||
|
||||
impl Theme {
|
||||
/// The player's choice in Settings (dark unless they picked another), the system's when they
|
||||
/// asked to follow it. `HORIZON_LAUNCHER_APPEARANCE=light` or `dark` overrides both (for
|
||||
/// screenshots and tests).
|
||||
/// The pinned look (`pinned_dark`: dark unless the player picked another), the system's when
|
||||
/// they asked to follow it.
|
||||
pub fn for_appearance(choice: Appearance, system: WindowAppearance) -> Self {
|
||||
match std::env::var("HORIZON_LAUNCHER_APPEARANCE").as_deref() {
|
||||
Ok("light") => return Self::light(),
|
||||
Ok("dark") => return Self::dark(),
|
||||
_ => {}
|
||||
}
|
||||
match (choice, system) {
|
||||
(Appearance::Light, _) => Self::light(),
|
||||
(Appearance::System, WindowAppearance::Light | WindowAppearance::VibrantLight) => {
|
||||
Self::light()
|
||||
}
|
||||
_ => Self::dark(),
|
||||
let system_dark = !matches!(
|
||||
system,
|
||||
WindowAppearance::Light | WindowAppearance::VibrantLight
|
||||
);
|
||||
if pinned_dark(choice).unwrap_or(system_dark) {
|
||||
Self::dark()
|
||||
} else {
|
||||
Self::light()
|
||||
}
|
||||
}
|
||||
|
||||
|
||||
@@ -1,6 +1,8 @@
|
||||
//! Custom Windows chrome. Other platforms keep their native window decorations.
|
||||
//! Custom Windows chrome. Other platforms keep their native window decorations; on macOS,
|
||||
//! `apply_appearance` repaints that chrome (the title bar) to match the chosen look.
|
||||
use crate::theme::Theme;
|
||||
use gpui::{Div, TitlebarOptions, Window};
|
||||
use horizon_launcher::backend::Appearance;
|
||||
|
||||
/// Whether the launcher draws its own title bar (`render`) rather than the system.
|
||||
pub const DRAWN: bool = cfg!(target_os = "windows");
|
||||
@@ -18,6 +20,44 @@ pub fn render(_theme: &Theme, _window: &Window) -> Option<Div> {
|
||||
None
|
||||
}
|
||||
|
||||
/// macOS keeps the window's appearance on the system setting, so a launcher set to Dark still
|
||||
/// draws a light title bar on a light desktop. Pin the NSWindow's appearance to the choice
|
||||
/// instead (`theme::pinned_dark`: `System` clears the pin, handing the chrome back to the
|
||||
/// system). Elsewhere the chrome is ours (Windows) or the system's (Linux).
|
||||
#[cfg(target_os = "macos")]
|
||||
pub fn apply_appearance(window: &Window, choice: Appearance) {
|
||||
use objc2_app_kit::{
|
||||
NSAppearance, NSAppearanceCustomization, NSAppearanceName, NSAppearanceNameAqua,
|
||||
NSAppearanceNameDarkAqua, NSView,
|
||||
};
|
||||
use raw_window_handle::{HasWindowHandle, RawWindowHandle};
|
||||
|
||||
// AppKit's name constants are extern statics: reading them is `unsafe` to rustc only.
|
||||
let name: Option<&'static NSAppearanceName> = match crate::theme::pinned_dark(choice) {
|
||||
Some(true) => Some(unsafe { NSAppearanceNameDarkAqua }),
|
||||
Some(false) => Some(unsafe { NSAppearanceNameAqua }),
|
||||
None => None,
|
||||
};
|
||||
// The trait, not `Window::window_handle` (which is gpui's own `AnyWindowHandle`).
|
||||
let Ok(handle) = HasWindowHandle::window_handle(window) else {
|
||||
return;
|
||||
};
|
||||
let RawWindowHandle::AppKit(appkit) = handle.as_raw() else {
|
||||
return;
|
||||
};
|
||||
// The handle is the window's content view; its `window` is the NSWindow itself. Both outlive
|
||||
// this call.
|
||||
let view = unsafe { appkit.ns_view.cast::<NSView>().as_ref() };
|
||||
let Some(native) = view.window() else {
|
||||
return;
|
||||
};
|
||||
let appearance = name.and_then(NSAppearance::appearanceNamed);
|
||||
native.setAppearance(appearance.as_deref());
|
||||
}
|
||||
|
||||
#[cfg(not(target_os = "macos"))]
|
||||
pub fn apply_appearance(_: &Window, _: Appearance) {}
|
||||
|
||||
#[cfg(target_os = "windows")]
|
||||
mod windows {
|
||||
use super::*;
|
||||
|
||||
@@ -0,0 +1,116 @@
|
||||
# The roadmap
|
||||
|
||||
`roadmap.toml` is the one source of the roadmap. `tools/roadmap.py build` turns it into
|
||||
[ROADMAP.md](../ROADMAP.md); the website's hub (playhorizon.dev/hub) and Kira read the same items. The work
|
||||
board stays the task-level view (every issue and pull request); the roadmap is the overview, and each pull
|
||||
request carries the `roadmap:<id>` label of the item it moves.
|
||||
|
||||
## An item
|
||||
|
||||
```toml
|
||||
[[item]]
|
||||
id = "server-dialogs" # lowercase words joined by dashes; never renamed (votes and links use it)
|
||||
title = "Server dialogs and login screens"
|
||||
status = "now" # now | next | later | help-wanted | shipped
|
||||
area = "servers" # one of the [[area]] ids, listed in the order of priority
|
||||
focus = true # optional: one of the 3 to 5 Now items in the overview
|
||||
ongoing = true # optional: a workstream that goes on after its pull requests merge
|
||||
plain = """Servers that show dialogs ... will work in Horizon.""" # players' words, at most 240 characters
|
||||
dev = """26.3's dialog packets and model (#1720), ...""" # crates, approach, what is left
|
||||
links = ["#1720", "#1734", "docs/hosting.md"] # #N, a repository path, or https://
|
||||
shipped_in = "v0.2.58" # shipped items only: a game tag, launcher@x.y.z, or "website"
|
||||
post = "..." # optional: the announcement when it ships, if `plain` doesn't read as one
|
||||
announce = true # optional: when it ships, Kira also posts it on X (`post`, else `plain`)
|
||||
```
|
||||
|
||||
- **No dates, ever**: Now, Next, Later. The check rejects month names, years, quarters and "next week".
|
||||
"Coming soon" is the only phrase for something waiting on someone else (Microsoft sign-in, CurseForge).
|
||||
- **Only what is decided.** Ideas stay in issues and in the suggestion queue until they are.
|
||||
- **Only what is true in a release** for shipped items: a merged pull request isn't shipped until a release has it.
|
||||
- `plain` is for players: what they will be able to do, not how. `dev` is for contributors: the code, the
|
||||
vanilla classes, the pull requests, what is left. Both stay public: no machines, accounts or private notes.
|
||||
- Help wanted items are good first contributions: a clear vanilla behaviour, an issue with steps, a place to
|
||||
start in `dev`.
|
||||
|
||||
## Keeping it current
|
||||
|
||||
Whoever moves the work (the orchestrator on each heartbeat, or anyone in their pull request):
|
||||
|
||||
1. `python3 tools/roadmap.py sync`: every item whose linked pull requests all went out in a release, whose
|
||||
linked issues are all closed and that isn't `ongoing` becomes `shipped`, with that release in
|
||||
`shipped_in`, on top of the shipped items. It rewrites `roadmap.toml` and ROADMAP.md; open a pull request
|
||||
with the change (`skip-release`).
|
||||
2. `python3 tools/roadmap.py check`: the file's rules, then GitHub's state of every link. It fails when a
|
||||
link is not an issue or pull request, when a Now item has no open pull request and none merged in the last
|
||||
14 days (link the new work, or move it to Next or Later), and when every link of a Help wanted item is
|
||||
closed. It also says which items `sync` will ship once a release has them.
|
||||
3. When work starts, opens a pull request or is decided: add or move the item, add its links, then
|
||||
`python3 tools/roadmap.py build`. Keep the overview's focus to the 3 to 5 biggest Now items.
|
||||
4. `python3 tools/roadmap.py labels` (after the change merges): creates a `roadmap:<id>` label for each new
|
||||
item, updates their colour (by status) and description, and adds the label to the open pull requests an item
|
||||
links. Label a new pull request for an item by hand or by linking it and running `labels` again. Labels of
|
||||
removed items are listed, never deleted.
|
||||
5. Once a week, write the week's summary in `roadmap/journal/<year>-<ISO week>.md` (for example
|
||||
`2026-43.md`): `# Title`, a paragraph or two for players, then `## Technical` and the same week for
|
||||
contributors, with its pull requests. `build` puts it into website/data/roadmap.json; the hub's Journal tab
|
||||
shows it among the releases, and `/data/journal.json` carries it to Kira's #updates and to X.
|
||||
6. Suggestions from the website and Discord reach the maintainers' private channel through Kira (below). A good
|
||||
one becomes an item in a normal pull request; none is published automatically.
|
||||
|
||||
CI runs `tests/test_roadmap.py` (in the Python tests), which fails when ROADMAP.md is not what `build` writes
|
||||
or when the file breaks a rule; `python3 tools/roadmap.py check --offline` runs the same rules without GitHub.
|
||||
|
||||
## The journal
|
||||
|
||||
The hub's Journal tab and `https://playhorizon.dev/data/journal.json` are built with each deploy of the website
|
||||
(`website/src/hub.js`). The tab shows every game and launcher release with its notes' changes, each placed under
|
||||
the roadmap item it moves (the pull request's `roadmap:<id>` label, else the item that links it), the merged pull
|
||||
requests no release has yet, and the weekly summaries above.
|
||||
|
||||
`journal.json` is what Kira reads for `#updates` and its X posts (kira's `src/journal.js`): one flat entry per
|
||||
merged pull request, release, shipped item and weekly summary, newest first, the latest 300.
|
||||
|
||||
```json
|
||||
{ "format": "horizon-journal", "version": 2, "generated": "…", "url": "https://playhorizon.dev/hub#journal",
|
||||
"entries": [
|
||||
{ "id": "pr-1788", "kind": "merge", "date": "…", "title": "the pull request's title", "url": "…",
|
||||
"number": 1788, "item": "discord-presence", "item_title": "Discord Rich Presence" },
|
||||
{ "id": "release-v0.2.57", "kind": "release", "date": "…", "title": "…", "plain": "one line", "url": "…",
|
||||
"tag": "v0.2.57" },
|
||||
{ "id": "shipped-server-resource-packs", "kind": "shipped", "date": "the release's", "title": "…",
|
||||
"plain": "…", "url": "https://playhorizon.dev/hub#server-resource-packs", "item": "…", "item_title": "…",
|
||||
"shipped_in": "v0.2.48", "post": "at most 240 characters", "announce": false },
|
||||
{ "id": "weekly-2026-43", "kind": "weekly", "date": "the week's last second", "title": "…", "plain": "…",
|
||||
"dev": "…", "url": "https://playhorizon.dev/hub#week-2026-43" } ] }
|
||||
```
|
||||
|
||||
- An `id` never changes: readers post each one once. `merge` entries are the pull requests players see (no
|
||||
`skip-release` label), plus any that moves a roadmap item; `item` is absent when none does.
|
||||
- `announce: true` (the item's `announce` key) asks Kira to post the shipped item on X too, with `post`.
|
||||
- `https://playhorizon.dev/data/roadmap.json` is `roadmap.toml` as JSON (`areas`, `items` with every key above,
|
||||
`overview`, the weekly summaries); an item's page is `https://playhorizon.dev/hub#<id>`.
|
||||
|
||||
## The intake: votes, bug reports, suggestions
|
||||
|
||||
The hub's forms and vote buttons talk to the telemetry server (`https://telemetry.playhorizon.dev`,
|
||||
`crates/horizon-telemetry-server`, `src/hub.rs` and `src/intake.rs`; its README lists the limits and settings).
|
||||
Kira uses the same endpoints, so a bug or an idea goes the same way from the site and from Discord.
|
||||
|
||||
| Endpoint | Body | Answer |
|
||||
| --- | --- | --- |
|
||||
| `POST /hub/vote` | `{"item": "<roadmap id>", "voter": "<random id, 16 to 64 characters>", "up": true}` | `{"item", "votes"}`; `"up": false` takes the vote back |
|
||||
| `GET /hub/votes` | | `{"votes": {"<item>": n}}`, a minute old at most |
|
||||
| `POST /hub/report` | `{"title", "did", "happened", "expected", "version"?, "system", "name"?}` | 201 `{"id", "issue": "<GitHub URL>"}`; 202 `{"id", "issue": null}` when GitHub was down (opened later) |
|
||||
| `POST /hub/suggest` | `{"text", "item"?, "name"?}` | 202 `{"id"}` |
|
||||
| `GET /hub/suggestions?after=<id>` | `Authorization: Bearer <HORIZON_TELEMETRY_HUB_TOKEN>` | `{"suggestions": [{"id", "text", "item"?, "name"?, "created_at"}]}`, oldest first |
|
||||
|
||||
- A report becomes an issue at once, labels `bug` and `from-website`, in the `#horizon-bugs` template (What I did,
|
||||
What happened, What I expected, Horizon version, OS, CPU, GPU) with "Reported on playhorizon.dev". Every field
|
||||
but the version and the name is required; mentions, `#123` references and HTML in people's text are made inert.
|
||||
- Suggestions are never published. Kira polls `/hub/suggestions` with the last id it relayed and posts each one
|
||||
to `#roadmap-suggestions`.
|
||||
- Errors are `{"error": "…"}`: 400 names the field (`"did: 3 to 2000 characters"`), 429 means too many from that
|
||||
address, 503 a full day or reports turned off (no GitHub token on the server).
|
||||
- The page shows the forms and the buttons only once `GET /hub/votes` answers. Until then it points to GitHub and
|
||||
Discord. It keeps a random voter id and the items it voted for in `localStorage` (`hub:voter`, `hub:voted`).
|
||||
|
||||
@@ -0,0 +1,17 @@
|
||||
# Single player becomes a server, servers send their packs
|
||||
|
||||
Single player now runs on its own server thread, as vanilla does, and a run of fixes made shields, tridents,
|
||||
elytra, maps, fishing, signs and books work there and for every server player. Servers can send you their
|
||||
resource packs, the launcher got its blocky new look, and the first pieces of Horizon's mod registry landed.
|
||||
Shader packs were taken out, to come back written from scratch.
|
||||
|
||||
## Technical
|
||||
|
||||
The server thread became the default (#1514), after guests and server-thread players reached parity: totems
|
||||
(#1463), death drops (#1464), signs and books (#1465, #1466), shields, tridents, crossbows and spyglasses
|
||||
(#1476), elytra (#1475), maps (#1510), fishing (#1509), wind charges (#1508), strikes and mob effects (#1512),
|
||||
the cursor stack on close (#1513). Server resource packs: the dedicated server offers them (#1562) and the
|
||||
client downloads, asks and applies them (#1569, #1570). Mod registry: index schema 1 and `.hpack` (#1634),
|
||||
`cargo horizon-mod check` (#1642), the submission service (#1659). Shader packs were removed (#1561) and the
|
||||
clean-room rewrite started from the format's documentation (#1584 onward). Releases now ship in batches of five
|
||||
pull requests, or six hours after the oldest (#1554).
|
||||
@@ -0,0 +1,482 @@
|
||||
# Horizon's roadmap: the one source of truth for ROADMAP.md, playhorizon.dev/roadmap and Kira's answers.
|
||||
# Edit this file, then run `python3 tools/roadmap.py build`. How to keep it current: roadmap/README.md.
|
||||
#
|
||||
# No dates, ever: an item is Now, Next or Later. Each item says the same thing twice: `plain` for players
|
||||
# (one or two sentences, at most 240 characters, so it fits a post when it ships) and `dev` for contributors
|
||||
# (crates, approach, what is left). Links are "#123" (an issue or a pull request), a path in the repository,
|
||||
# or an https URL. Only what is decided goes here; ideas wait in GitHub issues and the suggestion queue.
|
||||
# `focus = true` puts a Now item in the overview (3 to 5 of them). `ongoing = true` marks a workstream that goes on
|
||||
# after its linked pull requests merge: `sync` never ships it, so link its new pull requests as they open.
|
||||
|
||||
[overview]
|
||||
today_plain = """Horizon is Minecraft: Java Edition 26.3 rewritten from scratch in Rust, so it runs faster on the \
|
||||
same computer. Single player, LAN, servers, resource packs and Horizon's own mods work today, on your own copy of \
|
||||
the game."""
|
||||
today_dev = """A native Rust and wgpu reimplementation of Java 26.3: the same saves, rules and terrain, checked \
|
||||
against the real game by more than 300 differential harnesses (a Java oracle and a Rust probe on the same inputs). \
|
||||
Single player runs on its own server thread, like vanilla's integrated server."""
|
||||
help_plain = """Play it and tell us what differs from vanilla (Discord or GitHub), run the benchmark on your \
|
||||
computer, vote for what you want next, or pick one of the Help wanted items."""
|
||||
help_dev = """Read CONTRIBUTING.md, pick a Help wanted item or a To do card, check vanilla's code for the \
|
||||
behaviour, and paste the block `python3 tools/pr_ready.py` prints in your pull request."""
|
||||
|
||||
# Areas, in the project's order of priority: performance first, then modpacks and servers.
|
||||
[[area]]
|
||||
id = "performance"
|
||||
name = "Performance"
|
||||
|
||||
[[area]]
|
||||
id = "modpacks"
|
||||
name = "Modpacks"
|
||||
|
||||
[[area]]
|
||||
id = "servers"
|
||||
name = "Servers and multiplayer"
|
||||
|
||||
[[area]]
|
||||
id = "mods"
|
||||
name = "Mods and API"
|
||||
|
||||
[[area]]
|
||||
id = "gameplay"
|
||||
name = "Gameplay parity"
|
||||
|
||||
[[area]]
|
||||
id = "rendering"
|
||||
name = "Rendering"
|
||||
|
||||
[[area]]
|
||||
id = "launcher"
|
||||
name = "Launcher"
|
||||
|
||||
[[area]]
|
||||
id = "extras"
|
||||
name = "Horizon extras"
|
||||
|
||||
[[area]]
|
||||
id = "project"
|
||||
name = "Code and tools"
|
||||
|
||||
# ---------------------------------------------------------------------------------------------------- Now
|
||||
|
||||
[[item]]
|
||||
id = "smooth-frames"
|
||||
title = "Steady frames at long render distances"
|
||||
status = "now"
|
||||
area = "performance"
|
||||
focus = true
|
||||
plain = """Making Horizon faster than vanilla on every computer, with smooth camera movement even at 32 chunks, \
|
||||
by spreading the work better over the processor's cores."""
|
||||
dev = """Frame pacing at render distance 32 (#678): long frames come from work competing with the render thread. \
|
||||
In review: world generation workers build free structure starts instead of queueing them (#1760), the worker pool \
|
||||
leaves one core as vanilla does (#1778), and the terrain vertex arena is read as storage where flat draws run \
|
||||
(#1742). Still open: far terrain at 48 to 64 chunks (#718) and CPU-bound fields of block entities (#717). Every \
|
||||
change shows before and after numbers from `tools/perf_bench.py` against vanilla 26.3 (docs/benchmark.md)."""
|
||||
links = ["#678", "#1760", "#1778", "#1742", "#718", "#717", "docs/benchmark.md"]
|
||||
|
||||
[[item]]
|
||||
id = "block-storage"
|
||||
title = "Faster block lookups"
|
||||
status = "now"
|
||||
area = "performance"
|
||||
plain = """Speeding up the code that reads and writes the blocks of the world, which almost everything in the game \
|
||||
goes through: generation, lighting, meshing and ticking."""
|
||||
dev = """`PalettedContainer` and `PackedStorage` find an entry's word by multiply and shift instead of an integer \
|
||||
division (#1790, #1794); meshing looks up baked models by index, not by name (#1747). Each change keeps the paletted \
|
||||
storage harnesses identical and shows its microbenchmark (docs/performance/paletted-container-access-results.md)."""
|
||||
links = ["#1790", "#1794", "#1747", "docs/performance/paletted-container-access-results.md"]
|
||||
|
||||
[[item]]
|
||||
id = "modpack-worldgen"
|
||||
title = "Modpacks' world generation, natively"
|
||||
status = "now"
|
||||
area = "modpacks"
|
||||
announce = true
|
||||
focus = true
|
||||
plain = """Making the world-generation mods of popular modpacks (new structures, YUNG's dungeons and mineshafts, \
|
||||
packs built on Lithostitched) generate their worlds in Horizon, natively and fast."""
|
||||
dev = """`horizon-port-pack` carries a pack's data-driven content over; structure mods that need code get a native \
|
||||
port: YUNG's worldgen as written (#1746), Lithostitched's limited and guaranteed elements with pool and processor \
|
||||
modifiers (#1777), its processors as the game's own types (#1765). Proved by the structure blocks and layout \
|
||||
harnesses (#1753, #1757). Mods whose Java code does more than world generation don't run (docs/modpacks.md)."""
|
||||
links = ["#1746", "#1777", "#1765", "#1753", "#1757", "docs/modpacks.md"]
|
||||
|
||||
[[item]]
|
||||
id = "server-clients"
|
||||
title = "Playing on servers: everything shows as it should"
|
||||
status = "now"
|
||||
ongoing = true
|
||||
area = "servers"
|
||||
focus = true
|
||||
plain = """When you play on a server, other players, mobs, items and menus look and behave as in vanilla: skins, \
|
||||
poses, item names, inventories and server networks."""
|
||||
dev = """Client-of-a-server fixes in `game/remote*.rs` and `horizon-protocol`: mobs' aggressive and item-use flags \
|
||||
(#1802, #1798), ghost items after a remote menu (#1795), skins (#1652), cookies and transfer packets for proxy \
|
||||
networks (#1650), firework boosts (#1671), living-entity attributes and simulation distance (#1731), styled item \
|
||||
names (#1702), primed TNT between updates (#1710)."""
|
||||
links = ["#1802", "#1798", "#1795", "#1652", "#1650", "#1671", "#1731", "#1702", "#1710"]
|
||||
|
||||
[[item]]
|
||||
id = "server-thread"
|
||||
title = "Single player as a server: the last differences"
|
||||
status = "now"
|
||||
ongoing = true
|
||||
area = "gameplay"
|
||||
focus = true
|
||||
plain = """Single player now runs a small server in the background, as vanilla does. We are fixing what still \
|
||||
behaves differently there; every fix also works for LAN and server players."""
|
||||
dev = """Since #1514 single player runs on the server thread (`game/integrated.rs`) and the window joins it as a \
|
||||
client; `--in-frame` keeps the old path. The open `[server-thread]` issues list the gaps. In review: a tool that \
|
||||
changes a block ends the click (#1797), potions keep their potion over the connection (#1796), mobs' aggression \
|
||||
and arm swings (#1802). docs/server-levels.md."""
|
||||
links = ["#1514", "#1797", "#1796", "#1802", "docs/server-levels.md"]
|
||||
|
||||
[[item]]
|
||||
id = "mod-registry"
|
||||
title = "Horizon's mod registry"
|
||||
status = "now"
|
||||
area = "mods"
|
||||
announce = true
|
||||
focus = true
|
||||
plain = """One place for mods, modpacks and resource packs made for Horizon: browse them on the website and \
|
||||
install them from the launcher in one click."""
|
||||
dev = """Merged: the registry index (schema 1, `.hpack`, checks before install, #1634), `cargo horizon-mod check` \
|
||||
(#1642) and the submission service (`crates/horizon-mod-registry`, #1659). In review: the website's /mods (#1596) \
|
||||
and /mods/submit (#1635), and in the launcher the registry as a source (#1636), install, enable and takedowns \
|
||||
(#1637), the Mods page (#1638) and modpacks as their own profiles (#1640)."""
|
||||
links = ["#1634", "#1642", "#1659", "#1596", "#1635", "#1636", "#1637", "#1638", "#1640", "docs/mods.md"]
|
||||
|
||||
[[item]]
|
||||
id = "server-dialogs"
|
||||
title = "Server dialogs and login screens"
|
||||
status = "now"
|
||||
area = "servers"
|
||||
plain = """Servers that show dialogs, such as the register and login screens of AuthMe, will work in Horizon."""
|
||||
dev = """26.3's dialog packets and model (#1720), the dialog screen with its buttons and actions (#1734), then text \
|
||||
and boolean inputs (#1735)."""
|
||||
links = ["#1720", "#1734", "#1735"]
|
||||
|
||||
[[item]]
|
||||
id = "languages"
|
||||
title = "Play in your language"
|
||||
status = "now"
|
||||
area = "gameplay"
|
||||
plain = """Item names, container titles and server messages follow the language you pick, as in vanilla. Today \
|
||||
parts of the game stay in English."""
|
||||
dev = """Translatable components resolved through the selected language for items, containers and server text \
|
||||
(#1806), on top of the bundled languages the prepared resources carry (#1594). Left: the client's own screens \
|
||||
(#1672) and the main menu with zh_cn (#1774)."""
|
||||
links = ["#1806", "#1594", "#1672", "#1774"]
|
||||
|
||||
[[item]]
|
||||
id = "shader-packs"
|
||||
title = "Shader packs, written again from scratch"
|
||||
status = "now"
|
||||
ongoing = true
|
||||
area = "rendering"
|
||||
plain = """Shader packs were removed and are being rebuilt from scratch. They come back, off by default, once the \
|
||||
best-known packs draw properly."""
|
||||
dev = """A clean-room rewrite in `horizon-shaderpack`, from the packs' public format documentation only: reading \
|
||||
packs, the preprocessor and `.properties` files are merged (#1584, #1585, #1586); translating programs to WGSL \
|
||||
through naga, buffers, uniforms and the terrain, entity, sky, weather and hand stages are in review (#1698 to \
|
||||
#1801)."""
|
||||
links = ["#1561", "#1584", "#1586", "#1698", "#1771", "#1786", "#1801"]
|
||||
|
||||
[[item]]
|
||||
id = "discord-presence"
|
||||
title = "Discord Rich Presence"
|
||||
status = "now"
|
||||
area = "extras"
|
||||
announce = true
|
||||
plain = """Your Discord profile can show that you are playing Horizon, with a switch to turn it off."""
|
||||
dev = """A Discord IPC client on its own thread (#1787) and the presence with its setting (#1788). Merged: it ships \
|
||||
with the next release."""
|
||||
links = ["#1787", "#1788"]
|
||||
|
||||
[[item]]
|
||||
id = "lean-code"
|
||||
title = "A leaner codebase that builds faster"
|
||||
status = "now"
|
||||
ongoing = true
|
||||
area = "project"
|
||||
plain = """Cleaning up Horizon's code: removing what nothing uses and making it quicker to build, so fixes and new \
|
||||
features land faster."""
|
||||
dev = """A review of the whole tree: dead code and stubs removed (#1432, #1658), one probe binary per crate (#1453, \
|
||||
#1454), shared harness helpers (#1448), clippy clean on the whole tree (#1707). docs/architecture.md maps each \
|
||||
feature to its files and harnesses."""
|
||||
links = ["#1432", "#1658", "#1453", "#1454", "#1448", "#1707", "docs/architecture.md"]
|
||||
|
||||
# ---------------------------------------------------------------------------------------------------- Next
|
||||
|
||||
[[item]]
|
||||
id = "microsoft-sign-in"
|
||||
title = "Microsoft sign-in (coming soon)"
|
||||
status = "next"
|
||||
area = "launcher"
|
||||
announce = true
|
||||
plain = """Coming soon: sign in with your Microsoft account to play on online-mode servers. The code is ready; it \
|
||||
waits for Microsoft's approval."""
|
||||
dev = """Device-code sign-in in the launcher and online-mode login in the client (docs/microsoft-account.md). It is \
|
||||
turned on by setting the app's client id once Minecraft API access is approved; until then the launcher shows \
|
||||
"Coming soon"."""
|
||||
links = ["docs/microsoft-account.md", "#1270"]
|
||||
|
||||
[[item]]
|
||||
id = "curseforge"
|
||||
title = "CurseForge in the mod browser (coming soon)"
|
||||
status = "next"
|
||||
area = "modpacks"
|
||||
announce = true
|
||||
plain = """Coming soon: search and download CurseForge mods and modpacks from the launcher, as you can with \
|
||||
Modrinth today."""
|
||||
dev = """The mod browser lists CurseForge as coming soon (docs/mod-browser.md): it needs CurseForge API access. \
|
||||
Meanwhile packs import from a CurseForge zip or instance folder, and jars only CurseForge hosts come from the \
|
||||
player's own instance (docs/modpacks.md)."""
|
||||
links = ["docs/mod-browser.md", "docs/modpacks.md"]
|
||||
|
||||
[[item]]
|
||||
id = "benchmarks"
|
||||
title = "Fresh benchmarks against vanilla"
|
||||
status = "next"
|
||||
area = "performance"
|
||||
plain = """New public numbers comparing Horizon with vanilla on many kinds of computers, measured the same way \
|
||||
every time, on the website's Benchmarks page."""
|
||||
dev = """Redo the comparison after the current performance work (#1073); reliability, coverage and presentation \
|
||||
(#1346); a scene must count as loaded only once its first chunk arrives (#1749). Players' reports come in through \
|
||||
`--benchmark` and `horizon-launcher data benchmark` (docs/benchmark.md)."""
|
||||
links = ["#1073", "#1346", "#1749", "docs/benchmark.md"]
|
||||
|
||||
[[item]]
|
||||
id = "pistons-push"
|
||||
title = "Pistons push players and mobs"
|
||||
status = "next"
|
||||
area = "gameplay"
|
||||
plain = """Pistons and slime blocks will push players, mobs and items as in vanilla. Today moving blocks pass \
|
||||
through them."""
|
||||
dev = """Port `PistonMovingBlockEntity.moveCollidedEntities` and `moveStuckEntities` (honey), the slime bounce and \
|
||||
`Entity.limitPistonMovement` for `MoverType.PISTON`, in single player and for a server's players. Issues #1496, \
|
||||
#1609, #1608, #1704, #1758."""
|
||||
links = ["#1496", "#1609", "#1608", "#1704", "#1758"]
|
||||
|
||||
[[item]]
|
||||
id = "intel-mac"
|
||||
title = "Horizon on Intel Macs"
|
||||
status = "next"
|
||||
area = "launcher"
|
||||
plain = """Builds of the game and the launcher for Macs with an Intel processor."""
|
||||
dev = """x86_64 game and launcher builds, picked per processor (#1171). Before it ships it needs a run on a real \
|
||||
Intel Mac: Rosetta on Apple Silicon only proves the CPU code. Requests: #1161, #1792."""
|
||||
links = ["#1171", "#1161", "#1792"]
|
||||
|
||||
# ---------------------------------------------------------------------------------------------------- Later
|
||||
|
||||
[[item]]
|
||||
id = "ai-companion"
|
||||
title = "An optional AI teammate"
|
||||
status = "later"
|
||||
area = "extras"
|
||||
plain = """An AI teammate that plays beside you and that you can talk to. It is off unless you turn it on, and the \
|
||||
No AI switch hides it completely."""
|
||||
dev = """Draft pull requests: the companion (#1068), its safety modes and their evaluation (#1069), and a route \
|
||||
that finishes the game (#1070). Local models first; it ships only once the safety evaluation passes."""
|
||||
links = ["#1068", "#1069", "#1070"]
|
||||
|
||||
[[item]]
|
||||
id = "new-versions"
|
||||
title = "Following new Minecraft versions"
|
||||
status = "later"
|
||||
area = "gameplay"
|
||||
plain = """When Mojang releases a new version of the game, Horizon follows it, and every system is checked against \
|
||||
the new version again."""
|
||||
dev = """The port pipeline detects a release, diffs its classes against 26.3 and writes a port report \
|
||||
(docs/version-ports.md); the harnesses then run against the new version."""
|
||||
links = ["docs/version-ports.md"]
|
||||
|
||||
# ---------------------------------------------------------------------------------------------------- Help wanted
|
||||
|
||||
[[item]]
|
||||
id = "benchmark-your-pc"
|
||||
title = "Benchmark your computer"
|
||||
status = "help-wanted"
|
||||
area = "performance"
|
||||
plain = """Run Horizon's built-in benchmark and share the report: every new computer makes the performance work \
|
||||
more accurate. No coding needed."""
|
||||
dev = """`horizon-launcher play --arg=--benchmark --arg=standard` writes a JSON report; `horizon-launcher data \
|
||||
benchmark <report>` shows what would be sent and uploads it (website/docs/performance.md). Results from three \
|
||||
installs with the same hardware appear on the Benchmarks page. Example: #1711."""
|
||||
links = ["website/docs/performance.md", "#1711"]
|
||||
|
||||
[[item]]
|
||||
id = "end-city-banners"
|
||||
title = "End city banners keep their pattern"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """Banners in End cities show as plain magenta instead of with their pattern."""
|
||||
dev = """Compare the banner block entities the End city templates place with vanilla's (`EndCityPieces`, the \
|
||||
templates' block entity NBT, `BannerBlockEntity`'s patterns), in `crates/horizon-world/src/worldgen/structure/`. \
|
||||
Issue #1438; possibly related: #526."""
|
||||
links = ["#1438", "#526"]
|
||||
|
||||
[[item]]
|
||||
id = "end-city-loot"
|
||||
title = "Enchanted loot in End cities"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """Armour and tools in End city chests should come enchanted, as in vanilla."""
|
||||
dev = """`loot.rs` implements `enchant_with_levels`: find why the End city chest table's rolls come out bare, and \
|
||||
compare them with vanilla's for a few seeds. Issues #1437, #1660."""
|
||||
links = ["#1437", "#1660"]
|
||||
|
||||
[[item]]
|
||||
id = "item-cooldowns"
|
||||
title = "Cooldowns drawn on items"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """After you throw an ender pearl, its slot should show the cooldown sweeping away, as in vanilla."""
|
||||
dev = """Vanilla draws `ItemCooldowns`' percent as a white overlay over the slot \
|
||||
(`GuiGraphicsExtractor.itemDecorations` and `itemCooldown`) in the hotbar and in inventories. Issue #1763."""
|
||||
links = ["#1763"]
|
||||
|
||||
[[item]]
|
||||
id = "chat-settings"
|
||||
title = "Chat settings and team prefixes"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """The Hidden and Commands Only chat settings should hide chat, and team prefixes should appear before \
|
||||
names in chat."""
|
||||
dev = """Vanilla checks `ChatVisiblity` before it delivers chat and system messages (#1376), and chat uses the \
|
||||
team-formatted display name (#1378). Both issues have exact steps to reproduce."""
|
||||
links = ["#1376", "#1378"]
|
||||
|
||||
[[item]]
|
||||
id = "pointer-hand"
|
||||
title = "A pointing hand over buttons"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """The mouse pointer should turn into a pointing hand over menu buttons, as in vanilla 26.3."""
|
||||
dev = """26.3's `AbstractWidget` asks for a cursor from `CursorTypes` when it is hovered; winit's \
|
||||
`CursorIcon::Pointer` gives the same shape. Issue #1347."""
|
||||
links = ["#1347"]
|
||||
|
||||
[[item]]
|
||||
id = "text-field-keys"
|
||||
title = "Ctrl+Backspace and scroll bars in menus"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """Ctrl+Backspace should delete a whole word in the creative search, and every list's scroll bar should be \
|
||||
draggable."""
|
||||
dev = """`EditBox` deletes by word with Ctrl (#1764); the Game Rules and Statistics lists' scroll bars can't be \
|
||||
dragged (#1782, after #978)."""
|
||||
links = ["#1764", "#1782"]
|
||||
|
||||
[[item]]
|
||||
id = "chicken-flap"
|
||||
title = "Chickens flap while they fall"
|
||||
status = "help-wanted"
|
||||
area = "gameplay"
|
||||
plain = """Chickens should flap their wings while they fall, not stand still in the air."""
|
||||
dev = """Vanilla's `Chicken.aiStep` updates `flap` and `flapSpeed` when the chicken isn't on the ground, and the \
|
||||
model's wings follow them. Issue #1706."""
|
||||
links = ["#1706"]
|
||||
|
||||
# ---------------------------------------------------------------------------------------------------- Shipped
|
||||
# Newest first: `tools/roadmap.py sync` adds each newly shipped item on top.
|
||||
|
||||
[[item]]
|
||||
id = "server-resource-packs"
|
||||
title = "Server resource packs"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.48"
|
||||
area = "servers"
|
||||
plain = """Servers can send you their resource pack: Horizon asks, downloads it and applies it, like vanilla."""
|
||||
dev = """The dedicated server offers server.properties' pack (#1562); the client's pack manager, downloads, prompt \
|
||||
and Server Resource Packs setting (#1569, #1570)."""
|
||||
links = ["#1562", "#1569", "#1570"]
|
||||
|
||||
[[item]]
|
||||
id = "server-thread-default"
|
||||
title = "Single player on its own server thread"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.39"
|
||||
area = "gameplay"
|
||||
plain = """Single player runs on a server thread, as vanilla does, so the world keeps ticking smoothly while the \
|
||||
window draws."""
|
||||
dev = """`game/integrated.rs` runs a second `Game` with one level per dimension; the window joins it through \
|
||||
memory like a LAN guest (#1514)."""
|
||||
links = ["#1514", "docs/server-levels.md"]
|
||||
|
||||
[[item]]
|
||||
id = "metal-occlusion"
|
||||
title = "GPU occlusion culling on Macs"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.17"
|
||||
area = "performance"
|
||||
plain = """On Macs the GPU now skips terrain hidden behind hills and caves: 8 to 48% more frames per second at 32 \
|
||||
chunks on an M4 Pro."""
|
||||
dev = """GPU occlusion culling on Metal (#1434)."""
|
||||
links = ["#1434"]
|
||||
|
||||
[[item]]
|
||||
id = "gpu-animated-textures"
|
||||
title = "Animated textures on the GPU"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.5"
|
||||
area = "performance"
|
||||
plain = """Water, lava and other animated blocks are now animated by the graphics card: 1.7 to 2.4 times better 1% \
|
||||
lows on Intel graphics."""
|
||||
dev = """Frames uploaded once, no per-tick CPU blend or copy (#1239)."""
|
||||
links = ["#1239"]
|
||||
|
||||
[[item]]
|
||||
id = "far-detail"
|
||||
title = "Far Detail for integrated graphics"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.5"
|
||||
area = "performance"
|
||||
plain = """An optional Reduced setting for far terrain, suggested on integrated graphics, that saves 2 to 4 ms of GPU \
|
||||
time per frame."""
|
||||
dev = """Opt-in reduced far terrain (#1199), on far-terrain chunk summaries built on the workers (#1029)."""
|
||||
links = ["#1199", "#1029"]
|
||||
|
||||
[[item]]
|
||||
id = "mod-browser"
|
||||
title = "The launcher's mod browser"
|
||||
status = "shipped"
|
||||
shipped_in = "launcher@0.2.0"
|
||||
area = "modpacks"
|
||||
plain = """Search Modrinth for mods, modpacks and resource packs from the launcher; it says before installing what \
|
||||
works in Horizon."""
|
||||
dev = """The Mods page (#1154), Java mods checked before install (#1242), project pages, filters and galleries \
|
||||
(#1243), modpacks ported in the same step (#1246). docs/mod-browser.md."""
|
||||
links = ["#1154", "#1242", "#1243", "#1246", "docs/mod-browser.md"]
|
||||
|
||||
[[item]]
|
||||
id = "launcher-look"
|
||||
title = "A blocky, Minecraft-like launcher"
|
||||
status = "shipped"
|
||||
shipped_in = "launcher@0.2.0"
|
||||
area = "launcher"
|
||||
plain = """The launcher got a new blocky look in Horizon's purple, in dark and light."""
|
||||
dev = """The Blocks look (#1269), from `horizon-theme` (docs/design-system.md)."""
|
||||
links = ["#1269", "docs/design-system.md"]
|
||||
|
||||
[[item]]
|
||||
id = "dynamic-lights"
|
||||
title = "Dynamic lights"
|
||||
status = "shipped"
|
||||
shipped_in = "v2026.10.22"
|
||||
area = "extras"
|
||||
plain = """An optional extra: torches you hold, drop or set on fire light up what is around them."""
|
||||
dev = """Held, dropped and burning light sources (#1162), in Horizon Extras, off by default."""
|
||||
links = ["#1162"]
|
||||
|
||||
[[item]]
|
||||
id = "servers-page"
|
||||
title = "Host a server from the launcher"
|
||||
status = "shipped"
|
||||
shipped_in = "launcher-v0.15.0"
|
||||
area = "servers"
|
||||
plain = """The launcher's Servers page creates, starts, backs up and updates a Horizon server with buttons, and \
|
||||
invites friends."""
|
||||
dev = """The launcher's Servers page (#1026) over `horizon-server` (docs/hosting.md)."""
|
||||
links = ["#1026", "docs/hosting.md"]
|
||||
@@ -0,0 +1,239 @@
|
||||
import copy
|
||||
import datetime
|
||||
import json
|
||||
import tomllib
|
||||
import unittest
|
||||
from unittest import mock
|
||||
|
||||
from tools import roadmap
|
||||
|
||||
SAMPLE = '''[overview]
|
||||
today_plain = "a"
|
||||
today_dev = "b"
|
||||
help_plain = "c"
|
||||
help_dev = "d"
|
||||
|
||||
[[area]]
|
||||
id = "performance"
|
||||
name = "Performance"
|
||||
|
||||
# ---- Now
|
||||
|
||||
[[item]]
|
||||
id = "fast"
|
||||
title = "Fast"
|
||||
status = "now"
|
||||
area = "performance"
|
||||
focus = true
|
||||
plain = "Faster."
|
||||
dev = """Multiply, \\
|
||||
not divide (#10)."""
|
||||
links = ["#10"]
|
||||
|
||||
[[item]]
|
||||
id = "faster"
|
||||
title = "Faster"
|
||||
status = "now"
|
||||
area = "performance"
|
||||
focus = true
|
||||
plain = "Even faster."
|
||||
dev = "More (#11)."
|
||||
links = ["#11", "#12"]
|
||||
|
||||
[[item]]
|
||||
id = "fastest"
|
||||
title = "Fastest"
|
||||
status = "now"
|
||||
area = "performance"
|
||||
focus = true
|
||||
ongoing = true
|
||||
plain = "The fastest."
|
||||
dev = "Most (#13)."
|
||||
links = ["#13"]
|
||||
|
||||
# ---- Shipped
|
||||
|
||||
[[item]]
|
||||
id = "old"
|
||||
title = "Old"
|
||||
status = "shipped"
|
||||
shipped_in = "v0.2.1"
|
||||
area = "performance"
|
||||
plain = "Done."
|
||||
dev = "Done (#1)."
|
||||
links = ["#1"]
|
||||
'''
|
||||
|
||||
|
||||
def pull(state, merged_at=None, paths=("crates/horizon-client/src/game.rs",)):
|
||||
return {"kind": "PullRequest", "state": state, "merged_at": merged_at, "merge_commit": "abc" if merged_at else None,
|
||||
"paths": list(paths)}
|
||||
|
||||
|
||||
def issue(state):
|
||||
return {"kind": "Issue", "state": state, "merged_at": None, "merge_commit": None, "paths": []}
|
||||
|
||||
|
||||
class RepositoryRoadmap(unittest.TestCase):
|
||||
def test_the_roadmap_keeps_its_rules(self):
|
||||
self.assertEqual(roadmap.validate(roadmap.load()), [])
|
||||
|
||||
def test_generated_files_match_the_toml(self):
|
||||
for path, text in roadmap.outputs(roadmap.load()).items():
|
||||
self.assertEqual(path.read_text(), text, f"{path.name} is out of date: run `python3 tools/roadmap.py build`")
|
||||
|
||||
def test_site_data_has_every_item_in_one_line_text(self):
|
||||
data = json.loads(roadmap.site_data(tomllib.loads(SAMPLE)))
|
||||
self.assertEqual([item["id"] for item in data["items"]], ["fast", "faster", "fastest", "old"])
|
||||
self.assertEqual(data["items"][0]["dev"], "Multiply, not divide (#10).")
|
||||
self.assertEqual(data["areas"], [{"id": "performance", "name": "Performance"}])
|
||||
|
||||
|
||||
class Rules(unittest.TestCase):
|
||||
def setUp(self):
|
||||
self.data = tomllib.loads(SAMPLE)
|
||||
|
||||
def problems(self, **changes):
|
||||
data = copy.deepcopy(self.data)
|
||||
data["item"][0].update(changes)
|
||||
return roadmap.validate(data)
|
||||
|
||||
def test_the_sample_is_valid(self):
|
||||
self.assertEqual(roadmap.validate(self.data), [])
|
||||
|
||||
def test_unknown_status_area_and_key(self):
|
||||
self.assertTrue(any("status" in p for p in self.problems(status="soon")))
|
||||
self.assertTrue(any("area" in p for p in self.problems(area="nowhere")))
|
||||
self.assertTrue(any("unknown key" in p for p in self.problems(eta="soon")))
|
||||
|
||||
def test_plain_fits_a_post(self):
|
||||
self.assertTrue(any("at most 240" in p for p in self.problems(plain="x" * 241)))
|
||||
self.assertTrue(any("post" in p for p in self.problems(post="x" * 241)))
|
||||
|
||||
def test_shipped_needs_its_release(self):
|
||||
self.assertTrue(any("shipped_in" in p for p in self.problems(status="shipped", focus=False)))
|
||||
self.assertTrue(any("only shipped" in p for p in self.problems(shipped_in="v0.2.3")))
|
||||
self.assertTrue(any("not a release" in p for p in self.problems(status="shipped", focus=False,
|
||||
shipped_in="soon")))
|
||||
|
||||
def test_links_are_issues_urls_or_repository_paths(self):
|
||||
self.assertEqual(self.problems(links=["#4", "https://playhorizon.dev", "docs/benchmark.md"]), [])
|
||||
self.assertTrue(any("link" in p for p in self.problems(links=["docs/nothing-here.md"])))
|
||||
self.assertTrue(any("link" in p for p in self.problems(links=["http://example.com"])))
|
||||
|
||||
def test_ids_are_free_anchors_of_the_hub(self):
|
||||
for taken in ("roadmap", "now", "h-next", "tab-board"):
|
||||
self.assertTrue(any("taken by the hub page" in p for p in self.problems(id=taken)), taken)
|
||||
|
||||
def test_flags_are_true_or_false(self):
|
||||
self.assertEqual(self.problems(announce=True), [])
|
||||
self.assertTrue(any("announce is true or false" in p for p in self.problems(announce="yes")))
|
||||
|
||||
def test_three_to_five_items_in_focus(self):
|
||||
self.assertTrue(any("focus" in p for p in self.problems(focus=False)))
|
||||
|
||||
def test_no_dates(self):
|
||||
for text in ("Ready in March.", "Before 2027.", "In Q3.", "Next week.", "In 3 weeks.", "By the end of it."):
|
||||
self.assertTrue(roadmap.dated(text), text)
|
||||
for text in ("Coming soon.", "Pull request #2026.", "Java 26.3.", "Mobs march on.", "It may land."):
|
||||
self.assertIsNone(roadmap.dated(text), text)
|
||||
self.assertTrue(any("date" in p for p in self.problems(plain="Done in October.")))
|
||||
|
||||
|
||||
class Render(unittest.TestCase):
|
||||
def test_sections_links_and_the_overview(self):
|
||||
text = roadmap.render(tomllib.loads(SAMPLE))
|
||||
self.assertIn("## Now", text)
|
||||
self.assertIn("## Recently shipped", text)
|
||||
self.assertNotIn("## Later", text)
|
||||
self.assertIn("- **Fast**: Faster.", text)
|
||||
self.assertIn("Multiply, not divide ([#10](https://github.com/ludovic111/horizon/issues/10)).", text)
|
||||
# A link the technical text already gives isn't repeated; the others are listed after it.
|
||||
self.assertIn("More: [#12](https://github.com/ludovic111/horizon/issues/12)", text)
|
||||
self.assertIn("- **Old** (v0.2.1): Done.", text)
|
||||
|
||||
|
||||
class GitHubState(unittest.TestCase):
|
||||
now = datetime.datetime(2030, 1, 20, tzinfo=datetime.timezone.utc)
|
||||
|
||||
def test_a_now_item_without_live_pull_requests_is_stale(self):
|
||||
data = tomllib.loads(SAMPLE)
|
||||
states = {1: pull("MERGED", "2029-12-01T00:00:00Z"), 10: pull("OPEN"),
|
||||
11: pull("MERGED", "2029-11-01T00:00:00Z"), 12: issue("OPEN"),
|
||||
13: pull("MERGED", "2030-01-19T00:00:00Z")}
|
||||
problems, notes = roadmap.online_problems(data, states, self.now)
|
||||
self.assertEqual(len(problems), 1)
|
||||
self.assertIn("faster: stale", problems[0])
|
||||
self.assertTrue(any("fastest: ongoing" in note for note in notes))
|
||||
|
||||
def test_missing_numbers_are_reported(self):
|
||||
problems, _ = roadmap.online_problems(tomllib.loads(SAMPLE), {}, self.now)
|
||||
self.assertTrue(any("#10 is neither" in p for p in problems))
|
||||
|
||||
|
||||
class Journal(unittest.TestCase):
|
||||
def test_weekly_summaries_newest_first_with_their_monday(self):
|
||||
import tempfile
|
||||
from pathlib import Path
|
||||
with tempfile.TemporaryDirectory() as folder:
|
||||
folder = Path(folder)
|
||||
(folder / "2026-43.md").write_text("# A week\n\nPlain\nwords.\n\n## Technical\n\nDev (#1).\n")
|
||||
(folder / "2026-42.md").write_text("# Older\n\nPlain.\n\n## Technical\n\nDev.\n")
|
||||
(folder / "week-44.md").write_text("# Bad name\n")
|
||||
(folder / "2026-45.md").write_text("# No technical part\n\nPlain.\n")
|
||||
entries, problems = roadmap.weeks(folder)
|
||||
self.assertEqual([e["week"] for e in entries], ["2026-43", "2026-42"])
|
||||
self.assertEqual(entries[0], {"week": "2026-43", "date": "2026-10-19", "title": "A week",
|
||||
"plain": "Plain words.", "dev": "Dev (#1)."})
|
||||
self.assertEqual(len(problems), 2)
|
||||
|
||||
|
||||
class Labels(unittest.TestCase):
|
||||
def test_creates_updates_and_adds_labels(self):
|
||||
data = tomllib.loads(SAMPLE)
|
||||
existing = {"roadmap:fast": {"color": "5B3FD6", "description": "Roadmap, now: Fast"},
|
||||
"roadmap:faster": {"color": "000000", "description": "old"},
|
||||
"roadmap:gone": {"color": "000000", "description": ""}}
|
||||
states = {10: dict(pull("OPEN"), labels=["roadmap:fast"]), 11: dict(pull("OPEN"), labels=[]),
|
||||
13: dict(pull("MERGED", "2030-01-01T00:00:00Z"), labels=[])}
|
||||
changes, stale = roadmap.label_changes(data, existing, states)
|
||||
self.assertEqual([(action, target) for action, target, _ in changes],
|
||||
[("update", "roadmap:faster"), ("add", 11), ("create", "roadmap:fastest"),
|
||||
("create", "roadmap:old")])
|
||||
self.assertEqual(changes[0][2]["color"], "5b3fd6")
|
||||
self.assertEqual(stale, ["roadmap:gone"])
|
||||
|
||||
|
||||
class Sync(unittest.TestCase):
|
||||
def test_family_of_a_change(self):
|
||||
self.assertEqual(roadmap.family(["launcher/src/main.rs"]), "launcher")
|
||||
self.assertEqual(roadmap.family(["website/src/main.js"]), "website")
|
||||
self.assertEqual(roadmap.family(["launcher/src/main.rs", "crates/x/src/lib.rs"]), "game")
|
||||
|
||||
def test_merged_and_released_items_move_to_the_top_of_shipped(self):
|
||||
data = tomllib.loads(SAMPLE)
|
||||
states = {10: pull("MERGED", "2030-01-02T00:00:00Z"), 11: pull("MERGED", "2030-01-03T00:00:00Z"),
|
||||
12: issue("OPEN"), 13: pull("MERGED", "2030-01-03T00:00:00Z")}
|
||||
with mock.patch.object(roadmap, "first_release", return_value="v0.2.9") as release:
|
||||
text, log = roadmap.sync(data, SAMPLE, states)
|
||||
release.assert_called_once_with("abc", "game")
|
||||
# "faster" keeps an open issue and "fastest" is ongoing: only "fast" ships.
|
||||
self.assertEqual(log, ["fast: shipped in v0.2.9"])
|
||||
new = tomllib.loads(text)
|
||||
self.assertEqual([item["id"] for item in new["item"]], ["faster", "fastest", "fast", "old"])
|
||||
fast = new["item"][2]
|
||||
self.assertEqual((fast["status"], fast["shipped_in"]), ("shipped", "v0.2.9"))
|
||||
self.assertNotIn("focus", fast)
|
||||
self.assertEqual(fast["dev"], "Multiply, not divide (#10).")
|
||||
self.assertIn("# ---- Shipped\n\n[[item]]\nid = \"fast\"", text)
|
||||
|
||||
def test_merged_but_unreleased_items_wait(self):
|
||||
states = {10: pull("MERGED", "2030-01-02T00:00:00Z")}
|
||||
with mock.patch.object(roadmap, "first_release", return_value=None):
|
||||
text, log = roadmap.sync(tomllib.loads(SAMPLE), SAMPLE, states)
|
||||
self.assertEqual(text, SAMPLE)
|
||||
self.assertEqual(log, ["fast: merged, waiting for a release"])
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
unittest.main()
|
||||
@@ -6252,5 +6252,51 @@ CHECKS += ['crystals']
|
||||
CHECK_FNS.update(crystals=check_crystals)
|
||||
|
||||
|
||||
def check_sprint_fov(host, guest, out):
|
||||
"""Releasing Ctrl must preserve a sprint until W is released, then reset FOV.
|
||||
|
||||
PlayerInput reports keys; PlayerCommand starts/stops the sprint. Confusing
|
||||
them clears the client's sprint flag while leaving its speed modifier on.
|
||||
"""
|
||||
seen = {}
|
||||
for game in (host, guest):
|
||||
game('command', command='gamemode creative')
|
||||
game('command', command='effect clear @s')
|
||||
game.raw('options-set', 'fovEffectScale', '1.0')
|
||||
x, y, z = map(math.floor, pos_of(game))
|
||||
game('command', command=f'fill {x - 2} {y} {z - 2} {x + 2} {y + 3} {z + 20} minecraft:air')
|
||||
game('command', command=f'fill {x - 2} {y - 1} {z - 2} {x + 2} {y - 1} {z + 20} minecraft:stone')
|
||||
game('command', command=f'tp @s {x + 0.5} {y} {z + 0.5} 0 0')
|
||||
game.wait(20)
|
||||
try:
|
||||
game.raw('key', 'w', 'down')
|
||||
game.raw('key', 'ctrl', 'down')
|
||||
game.wait(10)
|
||||
started = game('state')['player']
|
||||
game.raw('key', 'ctrl', 'up')
|
||||
game.wait(10)
|
||||
released_ctrl = game('state')['player']
|
||||
game.raw('key', 'w', 'up')
|
||||
game.wait(20)
|
||||
stopped = game('state')['player']
|
||||
finally:
|
||||
game.raw('key', 'ctrl', 'up')
|
||||
game.raw('key', 'w', 'up')
|
||||
seen[game.name] = states = {
|
||||
label: {k: p[k] for k in ('sprinting', 'fov_modifier')}
|
||||
for label, p in [('started', started), ('released_ctrl', released_ctrl), ('stopped', stopped)]
|
||||
}
|
||||
for label in ('started', 'released_ctrl'):
|
||||
assert states[label]['sprinting'], f'{game.name} {label}: {states}'
|
||||
assert abs(states[label]['fov_modifier'] - 1.15) < 0.002, f'{game.name} {label}: {states}'
|
||||
assert not stopped['sprinting'], f'{game.name}: {states}'
|
||||
assert abs(stopped['fov_modifier'] - 1.0) < 0.002, f'{game.name}: {states}'
|
||||
return seen
|
||||
|
||||
|
||||
CHECKS += ['sprint-fov']
|
||||
CHECK_FNS['sprint-fov'] = check_sprint_fov
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
|
||||
+4
-2
@@ -108,7 +108,7 @@ def touched_crates(paths, packages):
|
||||
|
||||
def area(path):
|
||||
"""The part of the project a path belongs to; None for what goes with any change (docs, tests, harnesses)."""
|
||||
if is_doc(path) or path.startswith(("tests/", "mods/", "docs/")) or path == "research-lock.json" or \
|
||||
if is_doc(path) or path.startswith(("tests/", "mods/", "docs/", "roadmap/")) or path == "research-lock.json" or \
|
||||
(path.startswith("tools/") and not path.startswith("tools/ci/")):
|
||||
return None
|
||||
if path.startswith(("launcher/", "crates/horizon-prepare/")):
|
||||
@@ -288,7 +288,9 @@ def plan(args, base, changed, crates_of, libraries, dependencies):
|
||||
"""The checks for these changed files, in the order they run."""
|
||||
rust = any(workspace_rust(path) for path in changed)
|
||||
launcher = any(launcher_rust(path) for path in changed)
|
||||
python = any(path.endswith(".py") or path.startswith(("tests/", "tools/")) for path in changed)
|
||||
# The Python tests also hold ROADMAP.md to roadmap/roadmap.toml (tests/test_roadmap.py).
|
||||
python = any(path.endswith(".py") or path.startswith(("tests/", "tools/", "roadmap/")) or path == "ROADMAP.md"
|
||||
for path in changed)
|
||||
crates = touched_crates(changed, crates_of) if rust or TOKENS in changed else []
|
||||
# An unrecognised Rust path must not silently skip validation.
|
||||
if rust and crates == []:
|
||||
|
||||
@@ -0,0 +1,612 @@
|
||||
#!/usr/bin/env python3
|
||||
"""Horizon's roadmap: roadmap/roadmap.toml is the source, ROADMAP.md is generated from it.
|
||||
|
||||
python3 tools/roadmap.py build write ROADMAP.md and website/data/roadmap.json
|
||||
python3 tools/roadmap.py build --check fail when either is out of date (CI)
|
||||
python3 tools/roadmap.py check --offline the file's own rules (CI)
|
||||
python3 tools/roadmap.py check the same, then GitHub: links resolve, no stale Now item
|
||||
python3 tools/roadmap.py sync [--dry-run] items whose pull requests all merged become shipped,
|
||||
with the release they went out in
|
||||
python3 tools/roadmap.py labels [--dry-run] a `roadmap:<id>` label per item on GitHub, and on the open
|
||||
pull requests the item links
|
||||
|
||||
The online commands read GitHub with GITHUB_TOKEN, GH_TOKEN or `gh auth token`. Maintenance: roadmap/README.md.
|
||||
"""
|
||||
|
||||
import argparse
|
||||
import datetime
|
||||
import json
|
||||
import os
|
||||
import re
|
||||
import subprocess
|
||||
import sys
|
||||
import tomllib
|
||||
import urllib.parse
|
||||
import urllib.request
|
||||
from pathlib import Path
|
||||
|
||||
ROOT = Path(__file__).resolve().parent.parent
|
||||
SOURCE = ROOT / "roadmap" / "roadmap.toml"
|
||||
OUTPUT = ROOT / "ROADMAP.md"
|
||||
# What the website's hub reads (website/build.mjs), and serves at /data/roadmap.json for Kira and others.
|
||||
SITE_DATA = ROOT / "website" / "data" / "roadmap.json"
|
||||
# The journal's weekly summaries, one file per ISO week: roadmap/journal/2026-43.md (roadmap/README.md).
|
||||
JOURNAL = ROOT / "roadmap" / "journal"
|
||||
WEEK = re.compile(r"(\d{4})-(\d{2})\.md$")
|
||||
REPO = "ludovic111/horizon"
|
||||
SITE = "https://playhorizon.dev/hub"
|
||||
|
||||
STATUSES = {
|
||||
"now": "Now",
|
||||
"next": "Next",
|
||||
"later": "Later",
|
||||
"help-wanted": "Help wanted",
|
||||
"shipped": "Recently shipped",
|
||||
}
|
||||
PLAIN_MAX = 240 # one post's worth, so a shipped item can be announced as written
|
||||
TITLE_MAX = 70
|
||||
FOCUS_RANGE = (3, 5)
|
||||
STALE_DAYS = 14 # a Now item needs an open pull request, or one merged this recently
|
||||
LABEL_PREFIX = "roadmap:"
|
||||
# GitHub label colours by status, from the design system's palette.
|
||||
LABEL_COLOURS = {"now": "5b3fd6", "next": "9a86ff", "later": "c5c7d1", "help-wanted": "1d7a48", "shipped": "646875"}
|
||||
ITEM_KEYS = {"id", "title", "status", "area", "plain", "dev", "links", "focus", "ongoing", "shipped_in", "post",
|
||||
"announce"}
|
||||
|
||||
ISSUE = re.compile(r"#(\d+)$")
|
||||
ID = re.compile(r"[a-z0-9]+(-[a-z0-9]+)*$")
|
||||
# An item is the anchor playhorizon.dev/hub#<id>: it can't take the name of a tab, a section or a heading.
|
||||
RESERVED = {"main", "overview", "roadmap", "board", "journal", "contribute", "report", "suggest", "contributors",
|
||||
"hub-data", *STATUSES}
|
||||
RESERVED_PREFIXES = ("h-", "tab-", "col-", "week-", "journal-")
|
||||
RELEASE = re.compile(r"(v\d[\w.]*|launcher@\d[\w.]*|launcher-v\d[\w.]*|website)$")
|
||||
MONTHS = ("January|February|March|April|June|July|August|September|October|November|December")
|
||||
# Kira's rule: no dates and no promises of when. "Coming soon" is the one allowed phrase.
|
||||
DATE = re.compile(
|
||||
rf"\b(?:{MONTHS})\b|\bMay \d|(?<![#\w.])20\d\d(?!\w|\.\d)|\bQ[1-4]\b|\btomorrow\b|\btonight\b"
|
||||
r"|\b(?:next|this) (?:week|month|year)\b|\bin \d+ (?:days?|weeks?|months?)\b|\bby the end of\b",
|
||||
re.IGNORECASE)
|
||||
MONTH_CASE = re.compile(rf"\b(?:{MONTHS})\b")
|
||||
|
||||
|
||||
def load(path=SOURCE):
|
||||
with open(path, "rb") as source:
|
||||
return tomllib.load(source)
|
||||
|
||||
|
||||
def link_url(link):
|
||||
"""Where a link points: "#12" is an issue or a pull request (GitHub redirects one to the other)."""
|
||||
match = ISSUE.match(link)
|
||||
if match:
|
||||
return f"https://github.com/{REPO}/issues/{match[1]}"
|
||||
return link
|
||||
|
||||
|
||||
def dated(text):
|
||||
"""The first date or deadline in the text, or None. A month counts only capitalised ("march" is a verb)."""
|
||||
for match in DATE.finditer(text):
|
||||
if match[0].lower() not in MONTHS.lower().split("|") or MONTH_CASE.fullmatch(match[0]):
|
||||
return match[0]
|
||||
return None
|
||||
|
||||
|
||||
def validate(data, root=ROOT):
|
||||
"""The file's own rules, without the network. Returns a list of problems."""
|
||||
problems = []
|
||||
overview = data.get("overview", {})
|
||||
for key in ("today_plain", "today_dev", "help_plain", "help_dev"):
|
||||
if not str(overview.get(key, "")).strip():
|
||||
problems.append(f"overview: {key} is missing")
|
||||
areas = [area.get("id") for area in data.get("area", [])]
|
||||
if len(set(areas)) != len(areas):
|
||||
problems.append("areas: an id appears twice")
|
||||
seen = set()
|
||||
items = data.get("item", [])
|
||||
for index, item in enumerate(items):
|
||||
where = f"item {item.get('id') or index + 1}"
|
||||
for key in sorted(set(item) - ITEM_KEYS):
|
||||
problems.append(f"{where}: unknown key {key!r}")
|
||||
for key in ("id", "title", "status", "area", "plain", "dev"):
|
||||
if not str(item.get(key, "")).strip():
|
||||
problems.append(f"{where}: {key} is missing")
|
||||
ident = item.get("id", "")
|
||||
if ident and not ID.match(ident):
|
||||
problems.append(f"{where}: ids are lowercase words joined by dashes")
|
||||
if ident in RESERVED or ident.startswith(RESERVED_PREFIXES):
|
||||
problems.append(f"{where}: the id is taken by the hub page (hub#{ident} is a tab, a section or a heading)")
|
||||
if ident in seen:
|
||||
problems.append(f"{where}: the id appears twice")
|
||||
seen.add(ident)
|
||||
status = item.get("status")
|
||||
if status not in STATUSES:
|
||||
problems.append(f"{where}: status {status!r} is not one of {', '.join(STATUSES)}")
|
||||
if item.get("area") not in areas:
|
||||
problems.append(f"{where}: area {item.get('area')!r} is not declared in an [[area]]")
|
||||
if len(item.get("title", "")) > TITLE_MAX:
|
||||
problems.append(f"{where}: the title is longer than {TITLE_MAX} characters")
|
||||
for key in ("plain", "post"):
|
||||
if len(item.get(key, "")) > PLAIN_MAX:
|
||||
problems.append(f"{where}: {key} is {len(item[key])} characters, at most {PLAIN_MAX}")
|
||||
for key in ("title", "plain", "dev", "post"):
|
||||
found = dated(item.get(key, ""))
|
||||
if found:
|
||||
problems.append(f"{where}: {key} names a date or a deadline ({found!r}); the roadmap has none")
|
||||
shipped_in = item.get("shipped_in")
|
||||
if status == "shipped":
|
||||
if not shipped_in:
|
||||
problems.append(f"{where}: a shipped item needs shipped_in (a release tag, or \"website\")")
|
||||
elif not RELEASE.match(shipped_in):
|
||||
problems.append(f"{where}: shipped_in {shipped_in!r} is not a release tag or \"website\"")
|
||||
elif shipped_in:
|
||||
problems.append(f"{where}: only shipped items have shipped_in")
|
||||
for key in ("focus", "ongoing", "announce"):
|
||||
if key in item and not isinstance(item[key], bool):
|
||||
problems.append(f"{where}: {key} is true or false")
|
||||
if item.get("ongoing") and status not in ("now", "next", "later"):
|
||||
problems.append(f"{where}: only Now, Next and Later items are ongoing")
|
||||
if item.get("focus") and status != "now":
|
||||
problems.append(f"{where}: only Now items can be in focus")
|
||||
links = item.get("links", [])
|
||||
if not isinstance(links, list):
|
||||
problems.append(f"{where}: links is a list")
|
||||
links = []
|
||||
if not links and status != "later":
|
||||
problems.append(f"{where}: needs at least one link (an issue, a pull request or a doc)")
|
||||
for link in links:
|
||||
if ISSUE.match(link) or link.startswith("https://"):
|
||||
continue
|
||||
if link.startswith(("/", "http:")) or ".." in link or not (root / link).exists():
|
||||
problems.append(f"{where}: link {link!r} is neither #N, https:// nor a path in the repository")
|
||||
problems += weeks()[1] if root == ROOT else []
|
||||
focus = sum(1 for item in items if item.get("focus"))
|
||||
low, high = FOCUS_RANGE
|
||||
if not low <= focus <= high:
|
||||
problems.append(f"focus: {focus} items are in focus, the overview wants {low} to {high}")
|
||||
return problems
|
||||
|
||||
|
||||
def areas_in_order(data):
|
||||
return [(area["id"], area["name"]) for area in data.get("area", [])]
|
||||
|
||||
|
||||
def by_area(data, status):
|
||||
"""The items of a status, grouped by area in the areas' order, each group in the file's order."""
|
||||
items = [item for item in data.get("item", []) if item.get("status") == status]
|
||||
return [(name, [item for item in items if item["area"] == key])
|
||||
for key, name in areas_in_order(data) if any(item["area"] == key for item in items)]
|
||||
|
||||
|
||||
def linkify(text, links=()):
|
||||
"""Markdown links for the text's #N, and for the item's own paths and URLs where the text names them."""
|
||||
text = re.sub(r"(?<![\w\[/])#(\d+)\b", lambda m: f"[#{m[1]}]({link_url('#' + m[1])})", text)
|
||||
for link in links:
|
||||
if not ISSUE.match(link):
|
||||
text = re.sub(rf"(?<![\w/\[])(?<!\]\(){re.escape(link)}(?![\w/])", f"[{link}]({link})", text, count=1)
|
||||
return text
|
||||
|
||||
|
||||
def link_list(links):
|
||||
return " · ".join(f"[{link}]({link_url(link)})" for link in links)
|
||||
|
||||
|
||||
def render(data):
|
||||
"""ROADMAP.md, from the parsed TOML."""
|
||||
overview = data["overview"]
|
||||
items = data.get("item", [])
|
||||
out = [
|
||||
"# Horizon roadmap",
|
||||
"",
|
||||
"<!-- Generated by tools/roadmap.py from roadmap/roadmap.toml: edit that file, then run"
|
||||
" `python3 tools/roadmap.py build`. -->",
|
||||
"",
|
||||
"What is being done on Horizon, what comes next and where you can help. There are no dates: things are"
|
||||
" Now, Next or Later. Each item is said in plain words, with the technical picture folded under it."
|
||||
f" The same roadmap, with a Simple / Technical switch, the board, the journal and how to help, is on"
|
||||
f" [playhorizon.dev/hub]({SITE}). Pull requests carry the `roadmap:<id>` label of their item.",
|
||||
"",
|
||||
"## At a glance",
|
||||
"",
|
||||
overview["today_plain"].strip(),
|
||||
"",
|
||||
"**Being done now**",
|
||||
"",
|
||||
]
|
||||
out += [f"- **{item['title']}**: {item['plain'].strip()}" for item in items if item.get("focus")]
|
||||
nexts = [item["title"] for item in items if item.get("status") == "next"]
|
||||
if nexts:
|
||||
out += ["", "**Next**: " + "; ".join(nexts) + "."]
|
||||
out += ["", f"**How to help**: {overview['help_plain'].strip()}", "",
|
||||
f"**Developers**: {overview['help_dev'].strip()}"]
|
||||
for status, heading in STATUSES.items():
|
||||
groups = by_area(data, status)
|
||||
if not groups:
|
||||
continue
|
||||
out += ["", f"## {heading}"]
|
||||
if status == "shipped":
|
||||
# Newest first: the file's order, where `sync` puts each newly shipped item on top.
|
||||
out += [""] + [f"- **{item['title']}** ({item['shipped_in']}): {item['plain'].strip()} "
|
||||
f"{link_list(item['links'])}" for item in items if item.get("status") == status]
|
||||
continue
|
||||
for area, group in groups:
|
||||
out += ["", f"### {area}"]
|
||||
for item in group:
|
||||
out += ["", f"#### {item['title']}", "", item["plain"].strip(), "",
|
||||
"<details><summary>Technical</summary>", "", linkify(item["dev"].strip(), item.get("links", []))]
|
||||
more = [link for link in item.get("links", []) if not re.search(rf"{re.escape(link)}\b", item["dev"])]
|
||||
if more:
|
||||
out += ["", "More: " + link_list(more)]
|
||||
out += ["", "</details>"]
|
||||
return "\n".join(out) + "\n"
|
||||
|
||||
|
||||
def weeks(directory=JOURNAL):
|
||||
"""The weekly summaries, newest first: {"week", "date" (its Monday), "title", "plain", "dev"}, and problems."""
|
||||
entries, problems = [], []
|
||||
for path in sorted(directory.glob("*.md"), reverse=True) if directory.exists() else []:
|
||||
name = WEEK.match(path.name)
|
||||
text = path.read_text()
|
||||
parts = re.match(r"# (.+)\n\n(.+?)\n\n## Technical\n\n(.+)", text.strip() + "\n", re.S)
|
||||
if not name or not 1 <= int(name[2]) <= 53:
|
||||
problems.append(f"journal/{path.name}: name it by its ISO week, like 2026-43.md")
|
||||
continue
|
||||
if not parts:
|
||||
problems.append(f"journal/{path.name}: needs '# Title', the plain text, then '## Technical' and its text")
|
||||
continue
|
||||
monday = datetime.date.fromisocalendar(int(name[1]), int(name[2]), 1)
|
||||
entries.append({"week": path.stem, "date": monday.isoformat(), "title": parts[1].strip(),
|
||||
"plain": " ".join(parts[2].split()), "dev": " ".join(parts[3].split())})
|
||||
return entries, problems
|
||||
|
||||
|
||||
def site_data(data):
|
||||
"""website/data/roadmap.json: the items as the hub and Kira read them, in the file's order."""
|
||||
keys = ("id", "title", "status", "area", "plain", "dev", "links", "focus", "ongoing", "shipped_in", "post",
|
||||
"announce")
|
||||
out = {
|
||||
"format": "horizon-roadmap",
|
||||
"version": 1,
|
||||
"source": "roadmap/roadmap.toml",
|
||||
"overview": {key: " ".join(value.split()) for key, value in data["overview"].items()},
|
||||
"statuses": [{"id": key, "name": name} for key, name in STATUSES.items()],
|
||||
"areas": [{"id": key, "name": name} for key, name in areas_in_order(data)],
|
||||
"items": [{key: (" ".join(item[key].split()) if isinstance(item[key], str) else item[key])
|
||||
for key in keys if key in item} for item in data.get("item", [])],
|
||||
"journal": weeks()[0],
|
||||
}
|
||||
return json.dumps(out, indent=1, ensure_ascii=False) + "\n"
|
||||
|
||||
|
||||
def outputs(data):
|
||||
"""Every generated file and its content."""
|
||||
return {OUTPUT: render(data), SITE_DATA: site_data(data)}
|
||||
|
||||
|
||||
# --- GitHub ---------------------------------------------------------------------------------------------------
|
||||
|
||||
def token():
|
||||
for name in ("GITHUB_TOKEN", "GH_TOKEN"):
|
||||
if os.environ.get(name):
|
||||
return os.environ[name]
|
||||
try:
|
||||
return subprocess.run(["gh", "auth", "token"], capture_output=True, text=True, check=True).stdout.strip()
|
||||
except (OSError, subprocess.CalledProcessError):
|
||||
sys.exit("roadmap: reading GitHub needs GITHUB_TOKEN, GH_TOKEN or `gh auth login` (or use --offline)")
|
||||
|
||||
|
||||
def numbers_in(data):
|
||||
return sorted({int(ISSUE.match(link)[1]) for item in data.get("item", [])
|
||||
for link in item.get("links", []) if ISSUE.match(link)})
|
||||
|
||||
|
||||
def github_states(numbers, auth):
|
||||
"""{number: {"kind": "Issue" | "PullRequest", "state", "merged_at", "merge_commit", "paths"}} for those
|
||||
that exist, in one GraphQL request per hundred numbers."""
|
||||
owner, name = REPO.split("/")
|
||||
states = {}
|
||||
for start in range(0, len(numbers), 100):
|
||||
fields = "\n".join(
|
||||
f"n{n}: issueOrPullRequest(number: {n}) {{ __typename "
|
||||
"... on Issue { state } "
|
||||
"... on PullRequest { state mergedAt mergeCommit { oid } files(first: 100) { nodes { path } } "
|
||||
"labels(first: 50) { nodes { name } } } }"
|
||||
for n in numbers[start:start + 100])
|
||||
query = f'query {{ repository(owner: "{owner}", name: "{name}") {{ {fields} }} }}'
|
||||
request = urllib.request.Request(
|
||||
"https://api.github.com/graphql", data=json.dumps({"query": query}).encode(),
|
||||
headers={"Authorization": f"bearer {auth}", "User-Agent": "horizon-roadmap"})
|
||||
with urllib.request.urlopen(request, timeout=30) as response:
|
||||
answer = json.load(response)
|
||||
for key, node in (answer.get("data", {}).get("repository") or {}).items():
|
||||
if node:
|
||||
states[int(key[1:])] = {
|
||||
"kind": node["__typename"],
|
||||
"state": node["state"],
|
||||
"merged_at": node.get("mergedAt"),
|
||||
"merge_commit": (node.get("mergeCommit") or {}).get("oid"),
|
||||
"paths": [file["path"] for file in ((node.get("files") or {}).get("nodes") or [])],
|
||||
"labels": [label["name"] for label in ((node.get("labels") or {}).get("nodes") or [])],
|
||||
}
|
||||
return states
|
||||
|
||||
|
||||
def pull_requests(item, states):
|
||||
return [states[n] for n in (int(ISSUE.match(link)[1]) for link in item.get("links", []) if ISSUE.match(link))
|
||||
if n in states and states[n]["kind"] == "PullRequest"]
|
||||
|
||||
|
||||
def open_issues(item, states):
|
||||
return [n for n in (int(ISSUE.match(link)[1]) for link in item.get("links", []) if ISSUE.match(link))
|
||||
if n in states and states[n]["kind"] == "Issue" and states[n]["state"] == "OPEN"]
|
||||
|
||||
|
||||
def online_problems(data, states, now):
|
||||
"""What only GitHub can tell: links that don't exist, Now items nobody works on, Help wanted items already
|
||||
done, items `sync` would ship."""
|
||||
problems, notes = [], []
|
||||
recent = now - datetime.timedelta(days=STALE_DAYS)
|
||||
for item in data.get("item", []):
|
||||
where = f"item {item['id']}"
|
||||
for link in item.get("links", []):
|
||||
match = ISSUE.match(link)
|
||||
if match and int(match[1]) not in states:
|
||||
problems.append(f"{where}: {link} is neither an issue nor a pull request of {REPO}")
|
||||
pulls = pull_requests(item, states)
|
||||
status = item.get("status")
|
||||
if status == "now":
|
||||
alive = [p for p in pulls if p["state"] == "OPEN" or
|
||||
(p["merged_at"] and datetime.datetime.fromisoformat(p["merged_at"]) >= recent)]
|
||||
if not alive:
|
||||
problems.append(f"{where}: stale: Now, but no open pull request and none merged in the last "
|
||||
f"{STALE_DAYS} days (link the work, or move it to Next or Later)")
|
||||
if status == "help-wanted":
|
||||
issues = [states[int(ISSUE.match(link)[1])] for link in item.get("links", [])
|
||||
if ISSUE.match(link) and int(ISSUE.match(link)[1]) in states]
|
||||
if issues and all(i["state"] != "OPEN" for i in issues):
|
||||
problems.append(f"{where}: every linked issue and pull request is closed: ship or drop it")
|
||||
if status != "shipped" and pulls and all(p["state"] == "MERGED" for p in pulls):
|
||||
if item.get("ongoing"):
|
||||
notes.append(f"{where}: ongoing, and all its pull requests merged: link the new ones")
|
||||
elif not open_issues(item, states):
|
||||
notes.append(f"{where}: all its pull requests merged: `python3 tools/roadmap.py sync` ships it "
|
||||
"once a release has them")
|
||||
return problems, notes
|
||||
|
||||
|
||||
# --- sync -----------------------------------------------------------------------------------------------------
|
||||
|
||||
def family(paths):
|
||||
"""Which releases carry a change: the launcher's, the website (deployed from main) or the game's."""
|
||||
if paths and all(path.startswith("launcher/") for path in paths):
|
||||
return "launcher"
|
||||
if paths and all(path.startswith("website/") for path in paths):
|
||||
return "website"
|
||||
return "game"
|
||||
|
||||
|
||||
def first_release(commit, kind):
|
||||
"""The oldest release tag of this kind that contains the commit, or None while none does."""
|
||||
if kind == "website":
|
||||
return "website"
|
||||
tags = subprocess.run(["git", "tag", "--contains", commit, "--sort=creatordate"], cwd=ROOT,
|
||||
capture_output=True, text=True).stdout.split()
|
||||
wanted = (lambda tag: tag.startswith(("launcher@", "launcher-v"))) if kind == "launcher" else \
|
||||
(lambda tag: re.match(r"v\d", tag))
|
||||
return next((tag for tag in tags if wanted(tag)), None)
|
||||
|
||||
|
||||
def release_of(pulls):
|
||||
"""The release that shipped the last of these merged pull requests, or None."""
|
||||
kinds = {family(p["paths"]) for p in pulls}
|
||||
kind = "game" if "game" in kinds or len(kinds) > 1 else kinds.pop()
|
||||
latest = max(pulls, key=lambda p: p["merged_at"])
|
||||
return first_release(latest["merge_commit"], kind) if latest["merge_commit"] else None
|
||||
|
||||
|
||||
def item_span(lines, ident):
|
||||
"""[start, end) of the item's lines: its [[item]] header to its last key, without the comments that follow."""
|
||||
starts = [i for i, line in enumerate(lines) if line.strip() == "[[item]]"]
|
||||
for position, start in enumerate(starts):
|
||||
end = starts[position + 1] if position + 1 < len(starts) else len(lines)
|
||||
if not any(re.match(rf'id\s*=\s*"{re.escape(ident)}"\s*$', line) for line in lines[start:end]):
|
||||
continue
|
||||
while end > start and (not lines[end - 1].strip() or re.match(r"#(\s|-|$)", lines[end - 1])):
|
||||
end -= 1
|
||||
return start, end
|
||||
raise KeyError(ident)
|
||||
|
||||
|
||||
def mark_shipped(text, ident, release):
|
||||
"""The TOML with this item shipped in `release`, moved to the top of the shipped items (newest first)."""
|
||||
lines = text.split("\n")
|
||||
start, end = item_span(lines, ident)
|
||||
block = [line for line in lines[start:end] if not line.startswith("shipped_in")]
|
||||
block = [f'status = "shipped"\nshipped_in = "{release}"' if re.match(r"status\s*=", line) else line
|
||||
for line in block]
|
||||
block = [line for line in block if not re.match(r"focus\s*=", line)]
|
||||
rest = lines[:start] + lines[end:]
|
||||
# Drop the blank line the block leaves behind.
|
||||
if start < len(rest) and start > 0 and not rest[start - 1].strip() and not rest[start].strip():
|
||||
del rest[start]
|
||||
shipped = [i for i, line in enumerate(rest) if re.match(r'status\s*=\s*"shipped"', line)]
|
||||
if shipped:
|
||||
header = max(i for i in range(shipped[0] + 1) if rest[i].strip() == "[[item]]")
|
||||
rest[header:header] = block + [""]
|
||||
else:
|
||||
rest += [""] + block
|
||||
return "\n".join(rest)
|
||||
|
||||
|
||||
def sync(data, text, states):
|
||||
"""Ship every item whose linked pull requests all went out in a release and whose linked issues are all
|
||||
closed, unless it is ongoing. Returns the new text and what happened."""
|
||||
log = []
|
||||
for item in data.get("item", []):
|
||||
if item.get("status") == "shipped":
|
||||
continue
|
||||
pulls = pull_requests(item, states)
|
||||
# An ongoing item, or one with an open issue, still has work left whatever its pull requests say.
|
||||
if item.get("ongoing") or open_issues(item, states):
|
||||
continue
|
||||
if not pulls or any(p["state"] != "MERGED" for p in pulls):
|
||||
continue
|
||||
release = release_of(pulls)
|
||||
if release is None:
|
||||
log.append(f"{item['id']}: merged, waiting for a release")
|
||||
continue
|
||||
text = mark_shipped(text, item["id"], release)
|
||||
log.append(f"{item['id']}: shipped in {release}")
|
||||
return text, log
|
||||
|
||||
|
||||
# --- labels ---------------------------------------------------------------------------------------------------
|
||||
|
||||
def label_of(item):
|
||||
"""The GitHub label of an item: its name, colour and description (GitHub allows 100 characters)."""
|
||||
description = f"Roadmap, {STATUSES[item['status']].lower()}: {item['title']}"
|
||||
return {"name": LABEL_PREFIX + item["id"], "color": LABEL_COLOURS[item["status"]], "description": description[:100]}
|
||||
|
||||
|
||||
def label_changes(data, existing, states):
|
||||
"""What `labels` does: [(action, label or number, payload)] for labels to create or update, and open pull
|
||||
requests linked from an item that lack its label. existing: {name: {"color", "description"}}; states as
|
||||
github_states, plus each pull request's "labels"."""
|
||||
changes = []
|
||||
for item in data.get("item", []):
|
||||
label = label_of(item)
|
||||
have = existing.get(label["name"])
|
||||
if have is None:
|
||||
changes.append(("create", label["name"], label))
|
||||
elif (have.get("color", "").lower(), have.get("description") or "") != (label["color"], label["description"]):
|
||||
changes.append(("update", label["name"], label))
|
||||
for link in item.get("links", []):
|
||||
match = ISSUE.match(link)
|
||||
state = states.get(int(match[1])) if match else None
|
||||
if state and state["kind"] == "PullRequest" and state["state"] == "OPEN" and \
|
||||
label["name"] not in state.get("labels", []):
|
||||
changes.append(("add", int(match[1]), label["name"]))
|
||||
stale = sorted(set(existing) - {LABEL_PREFIX + item["id"] for item in data.get("item", [])})
|
||||
return changes, [name for name in stale if name.startswith(LABEL_PREFIX)]
|
||||
|
||||
|
||||
def github_rest(method, path, auth, body=None):
|
||||
request = urllib.request.Request(
|
||||
f"https://api.github.com{path}", method=method, data=None if body is None else json.dumps(body).encode(),
|
||||
headers={"Authorization": f"bearer {auth}", "Accept": "application/vnd.github+json",
|
||||
"User-Agent": "horizon-roadmap"})
|
||||
with urllib.request.urlopen(request, timeout=30) as response:
|
||||
return json.load(response) if response.status != 204 else None
|
||||
|
||||
|
||||
def existing_labels(auth):
|
||||
labels, page = {}, 1
|
||||
while True:
|
||||
batch = github_rest("GET", f"/repos/{REPO}/labels?per_page=100&page={page}", auth)
|
||||
labels.update({label["name"]: label for label in batch})
|
||||
if len(batch) < 100:
|
||||
return labels
|
||||
page += 1
|
||||
|
||||
|
||||
# --- commands -------------------------------------------------------------------------------------------------
|
||||
|
||||
def report(problems):
|
||||
for problem in problems:
|
||||
print(f"roadmap: {problem}", file=sys.stderr)
|
||||
return 1 if problems else 0
|
||||
|
||||
|
||||
def command_build(args):
|
||||
data = load()
|
||||
problems = validate(data)
|
||||
if problems:
|
||||
return report(problems)
|
||||
files = outputs(data)
|
||||
if args.check:
|
||||
stale = [path for path, text in files.items() if not path.exists() or path.read_text() != text]
|
||||
return report([f"{path.relative_to(ROOT)} is out of date: run `python3 tools/roadmap.py build`"
|
||||
for path in stale])
|
||||
for path, text in files.items():
|
||||
path.parent.mkdir(parents=True, exist_ok=True)
|
||||
path.write_text(text)
|
||||
print(f"roadmap: wrote {path.relative_to(ROOT)}")
|
||||
return 0
|
||||
|
||||
|
||||
def command_check(args):
|
||||
data = load()
|
||||
problems = validate(data)
|
||||
if not problems and not args.offline:
|
||||
states = github_states(numbers_in(data), token())
|
||||
online, notes = online_problems(data, states, datetime.datetime.now(datetime.timezone.utc))
|
||||
problems += online
|
||||
for note in notes:
|
||||
print(f"roadmap: {note}")
|
||||
if not problems:
|
||||
print(f"roadmap: {len(data.get('item', []))} items, all good")
|
||||
return report(problems)
|
||||
|
||||
|
||||
def command_sync(args):
|
||||
data = load()
|
||||
problems = validate(data)
|
||||
if problems:
|
||||
return report(problems)
|
||||
subprocess.run(["git", "fetch", "--quiet", "--tags", "origin"], cwd=ROOT, check=False)
|
||||
text, log = sync(data, SOURCE.read_text(), github_states(numbers_in(data), token()))
|
||||
for line in log:
|
||||
print(f"roadmap: {line}")
|
||||
if args.dry_run or text == SOURCE.read_text():
|
||||
return 0
|
||||
new = tomllib.loads(text)
|
||||
if len(new.get("item", [])) != len(data.get("item", [])) or validate(new):
|
||||
return report(["sync produced an invalid file; nothing written"] + validate(new))
|
||||
SOURCE.write_text(text)
|
||||
for path, content in outputs(new).items():
|
||||
path.write_text(content)
|
||||
print("roadmap: wrote roadmap/roadmap.toml, ROADMAP.md and website/data/roadmap.json")
|
||||
return 0
|
||||
|
||||
|
||||
def command_labels(args):
|
||||
data = load()
|
||||
problems = validate(data)
|
||||
if problems:
|
||||
return report(problems)
|
||||
auth = token()
|
||||
changes, stale = label_changes(data, existing_labels(auth), github_states(numbers_in(data), auth))
|
||||
for action, target, payload in changes:
|
||||
print(f"roadmap: {action} {target}" + (f" ({payload})" if action == "add" else ""))
|
||||
if args.dry_run:
|
||||
continue
|
||||
if action == "create":
|
||||
github_rest("POST", f"/repos/{REPO}/labels", auth, payload)
|
||||
elif action == "update":
|
||||
github_rest("PATCH", f"/repos/{REPO}/labels/{urllib.parse.quote(target, safe='')}", auth,
|
||||
{"color": payload["color"], "description": payload["description"]})
|
||||
else:
|
||||
github_rest("POST", f"/repos/{REPO}/issues/{target}/labels", auth, {"labels": [payload]})
|
||||
for name in stale:
|
||||
print(f"roadmap: {name} names no item any more: rename or delete it by hand (it stays on its pull requests)")
|
||||
if not changes:
|
||||
print("roadmap: labels up to date")
|
||||
return 0
|
||||
|
||||
|
||||
def main(argv=None):
|
||||
parser = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawDescriptionHelpFormatter)
|
||||
commands = parser.add_subparsers(dest="command", required=True)
|
||||
build = commands.add_parser("build", help="write ROADMAP.md")
|
||||
build.add_argument("--check", action="store_true", help="fail when ROADMAP.md is out of date")
|
||||
check = commands.add_parser("check", help="the roadmap's rules, and GitHub's state of its links")
|
||||
check.add_argument("--offline", action="store_true", help="skip GitHub")
|
||||
sync_command = commands.add_parser("sync", help="ship the items whose pull requests all merged")
|
||||
sync_command.add_argument("--dry-run", action="store_true", help="say what would change, write nothing")
|
||||
labels = commands.add_parser("labels", help="a roadmap:<id> label per item, on its linked open pull requests")
|
||||
labels.add_argument("--dry-run", action="store_true", help="say what would change, change nothing")
|
||||
args = parser.parse_args(argv)
|
||||
return {"build": command_build, "check": command_check, "sync": command_sync,
|
||||
"labels": command_labels}[args.command](args)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
sys.exit(main())
|
||||
+11
-1
@@ -33,8 +33,15 @@
|
||||
rewrite /privacy /privacy.html
|
||||
rewrite /releases /releases.html
|
||||
rewrite /benchmarks /benchmarks.html
|
||||
rewrite /hub /hub.html
|
||||
# The roadmap is the hub's Roadmap tab.
|
||||
redir /roadmap /hub#roadmap permanent
|
||||
@doc path_regexp doc ^/docs/([a-z-]+)$
|
||||
rewrite @doc /docs/{re.doc.1}.html
|
||||
# The API portal: /docs/api is its index, /docs/api/<page> its pages.
|
||||
redir /docs/api/ /docs/api permanent
|
||||
@apidoc path_regexp apidoc ^/docs/api/([a-z-]+)$
|
||||
rewrite @apidoc /docs/api/{re.apidoc.1}.html
|
||||
# The registry's submission service (crates/horizon-mod-registry), over Railway's private network. Unset, the
|
||||
# form says it isn't open.
|
||||
handle /api/mods/* {
|
||||
@@ -48,8 +55,11 @@
|
||||
file {path}.html /mods.html
|
||||
}
|
||||
rewrite @mod {file_match.relative}
|
||||
@pages path / /index.html /404.html /privacy.html /releases /releases.html /benchmarks /benchmarks.html /benchmarks.json /docs /docs/* /mods /mods.html /mods/* /sitemap.xml
|
||||
@pages path / /index.html /404.html /privacy.html /releases /releases.html /benchmarks /benchmarks.html /benchmarks.json /hub /hub.html /data/* /docs /docs/* /mods /mods.html /mods/* /sitemap.xml
|
||||
header @pages Cache-Control "no-cache"
|
||||
# The hub's data for Kira and anyone else: readable from any origin.
|
||||
@data path /data/*
|
||||
header @data Access-Control-Allow-Origin "*"
|
||||
@legal path /LEGAL.md /fonts/*.txt
|
||||
header @legal Content-Type "text/plain; charset=utf-8"
|
||||
|
||||
|
||||
@@ -5,6 +5,7 @@ WORKDIR /site
|
||||
COPY build.mjs ./
|
||||
COPY src ./src
|
||||
COPY docs ./docs
|
||||
COPY data ./data
|
||||
COPY public ./public
|
||||
COPY LEGAL.md ./
|
||||
ARG GITHUB_TOKEN
|
||||
|
||||
+11
-2
@@ -25,6 +25,7 @@ src/404.html the not-found page
|
||||
src/privacy.html what the launcher can send when players allow it, retention, deletion (/privacy)
|
||||
src/releases.html every release, newest first, with what it adds and fixes, its notes and downloads (/releases)
|
||||
src/benchmarks.html Horizon against vanilla 26.3 on our machines, the hardware picker, players' results (/benchmarks)
|
||||
src/hub.html the hub (/hub, /roadmap redirects to its Roadmap tab): Overview, Roadmap, Kanban, Journal, Contribute, a Simple / Technical switch
|
||||
src/mods.html the registry's list (/mods) and a page per project (/mods/<id>), one template
|
||||
src/docs.html the template of every documentation page (/docs/...), with its left navigation
|
||||
src/tokens.css the design tokens, generated from crates/horizon-theme (do not edit)
|
||||
@@ -41,6 +42,9 @@ src/estimate.js estimates for unmeasured hardware from the nearest measured m
|
||||
src/markdown.js a small Markdown renderer (escapes everything), shared by build and page
|
||||
src/releases.js the home page's "Recently added" and the Releases page's markup, shared by build and page
|
||||
src/contributors.js the contributors' filtering and markup, shared by build and page
|
||||
src/hub.js the hub's roadmap, board and journal from data/roadmap.json, GitHub's issues and the releases, shared by build and page; /data/journal.json
|
||||
src/hub-page.js the hub page: tabs by #hash, the Simple / Technical switch (localStorage), the area filter, live states
|
||||
data/roadmap.json the roadmap, generated by tools/roadmap.py from roadmap/roadmap.toml (do not edit); served at /data/roadmap.json
|
||||
public/ fonts, screenshots, icons, og.png, robots.txt, benchmarks.json: copied as is (sitemap.xml is written by the build)
|
||||
data/benchmarks/ our raw benchmark reports (tools/perf_bench.py) and fleet.json, the list scripts/benchmarks.mjs reads
|
||||
scripts/benchmarks.mjs benchmark reports -> public/benchmarks.json (ours, and players' groups of 3+ installs)
|
||||
@@ -77,8 +81,13 @@ mark merged-but-unreleased things "next release". `{{HARNESSES}}` and `{{PERCENT
|
||||
the README. A line holding only `` becomes a figure (the file must be in
|
||||
`public/media/`); links to other pages are `/docs/<slug>#heading`. The build checks every link
|
||||
between pages and every image, and fails with the list when one is broken. `/server`
|
||||
redirects to `/docs/hosting`. The developer docs in the repository's `docs/` stay as they are and are linked from
|
||||
the Contributing page.
|
||||
redirects to `/docs/hosting`.
|
||||
|
||||
The API portal is the repository's `docs/api/`, not a copy: `nav.json` lists its README as `api` (`/docs/api`) and
|
||||
its pages as `api/<page>` (`/docs/api/<page>`), read from the checkout or from `main` on GitHub like the README.
|
||||
Links between its pages become the site's, every other relative link goes to the file on GitHub, and the same link
|
||||
check applies. Markdown tables render as tables. The other developer docs in `docs/` stay on GitHub and are linked
|
||||
from the Contributing page.
|
||||
|
||||
## Run it locally
|
||||
|
||||
|
||||
+107
-15
@@ -3,12 +3,13 @@
|
||||
// docs/nav.json), plus public/ and fingerprinted CSS and JS. No dependencies.
|
||||
//
|
||||
// Railway builds only website/, so the README and links.json come from the repo when they
|
||||
// are next to it (a local checkout) and from main on GitHub otherwise. The documentation lives in website/. The latest releases and
|
||||
// are next to it (a local checkout) and from main on GitHub otherwise. The documentation lives in website/, except the
|
||||
// API portal (docs/api/), read the same way as the README. The latest releases and
|
||||
// the contributors are baked in when GitHub answers, so the page reads well before (or without) JavaScript.
|
||||
import { readFile, writeFile, mkdir, rm, cp } from "node:fs/promises";
|
||||
import { existsSync } from "node:fs";
|
||||
import { createHash } from "node:crypto";
|
||||
import { join, dirname } from "node:path";
|
||||
import { join, dirname, posix } from "node:path";
|
||||
import { fileURLToPath } from "node:url";
|
||||
import { markdown, inline, section, escape } from "./src/markdown.js";
|
||||
import { recentHtml, releasesPageHtml } from "./src/releases.js";
|
||||
@@ -16,6 +17,7 @@ import { machinesHtml, playersHtml } from "./src/bench.js";
|
||||
import { CPUS, GPUS, singleThread } from "./src/hardware.js";
|
||||
import { isGame, isLauncher, launcherVersion, newestFirst } from "./src/versions.js";
|
||||
import { contributorsFrom, contributorsHtml } from "./src/contributors.js";
|
||||
import { areaFilterHtml, boardFilterHtml, boardFrom, boardHtml, creditFrom, creditHtml, helpWantedHtml, journalFrom, journalHtml, journalJson, overviewHtml, roadmapHtml, slimIssue, suggestItemsHtml } from "./src/hub.js";
|
||||
import { INDEX_URL, KINDS, SUBMIT, listHtml, projectHtml, readIndex, submitHtml } from "./src/mods.js";
|
||||
|
||||
const site = dirname(fileURLToPath(import.meta.url));
|
||||
@@ -93,6 +95,59 @@ try {
|
||||
console.warn(`contributors: ${e.message}; the page will load them itself`);
|
||||
}
|
||||
|
||||
// The hub's roadmap (data/roadmap.json, generated from roadmap/roadmap.toml by tools/roadmap.py) and the live state
|
||||
// of the issues and pull requests its items link: the open ones and those closed lately, then (with a token) the
|
||||
// older ones in one GraphQL request. Without GitHub the hub shows the links without their state.
|
||||
const roadmap = JSON.parse(await readFile(join(site, "data", "roadmap.json"), "utf8"));
|
||||
const linked = new Set(roadmap.items.flatMap((i) => (i.links || []).map((l) => Number((l.match(/^#(\d+)$/) || [])[1])).filter(Boolean)));
|
||||
let hubLive = [];
|
||||
try {
|
||||
const urls = [1, 2, 3].map((p) => `https://api.github.com/repos/${REPO}/issues?state=open&per_page=100&page=${p}`);
|
||||
urls.push(`https://api.github.com/repos/${REPO}/issues?state=closed&sort=updated&direction=desc&per_page=100`);
|
||||
for (const url of urls) {
|
||||
const res = await fetch(url, { headers: githubHeaders, signal: AbortSignal.timeout(15000) });
|
||||
if (!res.ok) throw new Error(`${res.status} from GitHub`);
|
||||
hubLive.push(...(await res.json()).map(slimIssue));
|
||||
}
|
||||
const missing = [...linked].filter((n) => !hubLive.some((i) => i.n === n));
|
||||
if (missing.length && process.env.GITHUB_TOKEN) {
|
||||
const fields = missing.map((n) => `n${n}: issueOrPullRequest(number: ${n}) { ... on Issue { number title state stateReason url } ... on PullRequest { number title state isDraft mergedAt url } }`).join(" ");
|
||||
const res = await fetch("https://api.github.com/graphql", {
|
||||
method: "POST",
|
||||
headers: githubHeaders,
|
||||
body: JSON.stringify({ query: `query { repository(owner: "ludovic111", name: "horizon") { ${fields} } }` }),
|
||||
signal: AbortSignal.timeout(15000),
|
||||
});
|
||||
const nodes = Object.values((await res.json()).data?.repository || {}).filter(Boolean);
|
||||
hubLive.push(
|
||||
...nodes.map((x) =>
|
||||
slimIssue({
|
||||
number: x.number, title: x.title, html_url: x.url, draft: x.isDraft,
|
||||
state: x.state === "OPEN" ? "open" : "closed", state_reason: x.stateReason === "NOT_PLANNED" ? "not_planned" : null,
|
||||
pull_request: "isDraft" in x ? { merged_at: x.mergedAt } : undefined,
|
||||
}),
|
||||
),
|
||||
);
|
||||
}
|
||||
} catch (e) {
|
||||
console.warn(`hub: ${e.message}; the page will load the states itself`);
|
||||
}
|
||||
const hubLinked = new Map(hubLive.filter((i) => linked.has(i.n)).map((i) => [i.n, i]));
|
||||
const board = boardFrom(hubLive, roadmap);
|
||||
const journal = journalFrom(releases, hubLive, roadmap);
|
||||
|
||||
// The hub's server (crates/horizon-telemetry-server: votes, bug reports, suggestions), and Kira's list of the
|
||||
// contributors who linked their Discord account and agreed to be credited (kira's /contributors.json).
|
||||
const hubApi = process.env.HUB_API_URL || "https://telemetry.playhorizon.dev";
|
||||
let kiraCredit = {};
|
||||
try {
|
||||
const res = await fetch(process.env.KIRA_CONTRIBUTORS_URL || "https://kira-production-500e.up.railway.app/contributors.json", { signal: AbortSignal.timeout(10000) });
|
||||
if (!res.ok) throw new Error(`${res.status} from Kira`);
|
||||
kiraCredit = await res.json();
|
||||
} catch (e) {
|
||||
console.warn(`hub: contributors' Discord names: ${e.message}`);
|
||||
}
|
||||
|
||||
// --- The parity table ------------------------------------------------------------------
|
||||
|
||||
const status = section(readme, "Project status") ?? "";
|
||||
@@ -186,7 +241,7 @@ await writeFile(join(dist, "favicon.ico"), Buffer.concat([ico, png32]));
|
||||
const names = {};
|
||||
const rewrite = (code) => code.replace(/"\.\/(\w+\.js)"/g, (all, file) => (names[file] ? `"./${names[file]}"` : all));
|
||||
// Dependencies before what imports them.
|
||||
const modules = ["markdown.js", "versions.js", "chrome.js", "hardware.js", "estimate.js", "releases.js", "contributors.js", "bench.js", "main.js", "releases-page.js", "benchmarks-page.js", "docs-page.js", "mods.js", "mods-page.js", "mods-submit.js"];
|
||||
const modules = ["markdown.js", "versions.js", "chrome.js", "hardware.js", "estimate.js", "releases.js", "contributors.js", "bench.js", "hub.js", "main.js", "releases-page.js", "benchmarks-page.js", "docs-page.js", "hub-page.js", "mods.js", "mods-page.js", "mods-submit.js"];
|
||||
for (const file of modules) {
|
||||
const code = rewrite(await readFile(join(site, "src", file), "utf8"));
|
||||
names[file] = `${file.replace(".js", "")}.${fingerprint(code)}.js`;
|
||||
@@ -219,7 +274,7 @@ const unavailable = `<p class="lede">The release notes could not be loaded here.
|
||||
|
||||
// One top bar and phone menu for Home, Releases, Benchmarks and every Docs page.
|
||||
const navSections = [["/#about", "About"], ["/#screenshots", "In game"], ["/#parity", "Parity"], ["/#launcher", "Launcher"], ["/#recent", "New", "Recently added"], ["/#community", "Community"]];
|
||||
const navPages = [["/mods", "Mods"], ["/releases", "Releases"], ["/benchmarks", "Benchmarks"], ["/docs/", "Docs", "Documentation"]];
|
||||
const navPages = [["/hub", "Hub"], ["/mods", "Mods"], ["/releases", "Releases"], ["/benchmarks", "Benchmarks"], ["/docs/", "Docs", "Documentation"]];
|
||||
const navLink = ([href, label, menuLabel], current, menu = false) =>
|
||||
`<a href="${href}"${href === current ? ' aria-current="page"' : ""}${href === "/#contributors" ? ` data-contributors${contributors.length ? "" : " hidden"}` : ""}>${menu && menuLabel ? menuLabel : label}</a>`;
|
||||
const siteNav = (current) => ` <header class="nav" id="top">
|
||||
@@ -249,7 +304,7 @@ const siteFooter = ` <footer class="footer">
|
||||
<div class="container">
|
||||
<div class="footer-bar">
|
||||
<span class="footer-mark">Made in the open, in Rust.</span>
|
||||
<nav class="footer-links" aria-label="Elsewhere"><a href="/">Home</a><a href="/mods">Mods</a><a href="/releases">Releases</a><a href="/benchmarks">Benchmarks</a><a href="/docs/">Docs</a><a href="/docs/how-horizon-is-built">How it's built</a><a href="https://github.com/${REPO}">GitHub</a><a href="/privacy">Privacy</a><a href="/LEGAL.md">Assets</a></nav>
|
||||
<nav class="footer-links" aria-label="Elsewhere"><a href="/">Home</a><a href="/hub">Hub</a><a href="/mods">Mods</a><a href="/releases">Releases</a><a href="/benchmarks">Benchmarks</a><a href="/docs/">Docs</a><a href="/docs/how-horizon-is-built">How it's built</a><a href="https://github.com/${REPO}">GitHub</a><a href="/privacy">Privacy</a><a href="/LEGAL.md">Assets</a></nav>
|
||||
</div>
|
||||
</div>
|
||||
<p class="footer-word" aria-hidden="true">horizon</p>
|
||||
@@ -298,21 +353,52 @@ const values = {
|
||||
CONTRIBUTORS: contributorsHtml(contributors),
|
||||
CONTRIBUTORS_HIDDEN: contributors.length ? "" : " hidden",
|
||||
BAKED: JSON.stringify(baked).replace(/</g, "\\u003c"),
|
||||
HUB_JS: `/assets/${names["hub-page.js"]}`,
|
||||
HUB_OVERVIEW: overviewHtml(roadmap, hubLinked),
|
||||
HUB_ROADMAP: roadmapHtml(roadmap, hubLinked),
|
||||
HUB_AREAS: areaFilterHtml(roadmap),
|
||||
HUB_HELP_WANTED: helpWantedHtml(roadmap),
|
||||
HUB_BOARD: hubLive.length ? boardHtml(board, roadmap) : `<p class="lede">The board could not be loaded here.</p>`,
|
||||
HUB_BOARD_FILTER: boardFilterHtml(board, roadmap),
|
||||
HUB_JOURNAL: journalHtml(journal, roadmap) || unavailable,
|
||||
HUB_DATA: JSON.stringify({ roadmap, live: [...hubLinked.values()], api: hubApi }).replace(/</g, "\\u003c"),
|
||||
HUB_SUGGEST_ITEMS: suggestItemsHtml(roadmap),
|
||||
HUB_VERSION: escape(game[0]?.tag_name || ""),
|
||||
HUB_CREDIT: creditHtml(creditFrom(contributors, kiraCredit)),
|
||||
YEAR: String(new Date().getUTCFullYear()),
|
||||
};
|
||||
|
||||
// --- The documentation ---------------------------------------------------------------------
|
||||
// website/docs/<slug>.md: "# Title", a one-paragraph lede, then the body. docs/nav.json orders them in groups.
|
||||
// The API portal is the repository's docs/api/ (the pages and their generated references): nav.json lists it as
|
||||
// `api` (its README, /docs/api) and `api/<page>` (/docs/api/<page>). Its links are written for GitHub, so links
|
||||
// between its pages become the site's and every other relative link goes to the file on GitHub.
|
||||
|
||||
const docsNav = JSON.parse(await readFile(join(site, "docs", "nav.json"), "utf8"));
|
||||
const docSlugs = new Set(docsNav.flatMap((g) => g.pages));
|
||||
const apiSource = (slug) => `docs/api/${slug === "api" ? "README" : slug.slice(4)}.md`;
|
||||
function apiLinks(text, from) {
|
||||
return text.replace(/\]\(([^)\s]+)\)/g, (all, url) => {
|
||||
if (url.startsWith("https://playhorizon.dev/")) return `](${url.slice(23)})`;
|
||||
if (/^([a-z]+:|#|\/)/i.test(url)) return all;
|
||||
const [file, id] = url.split("#");
|
||||
const path = posix.normalize(posix.join(posix.dirname(from), file));
|
||||
const page = path.match(/^docs\/api\/([\w-]+)\.md$/)?.[1];
|
||||
const slug = page === "README" ? "api" : page && `api/${page}`;
|
||||
const to = docSlugs.has(slug) ? `/docs/${slug}` : `https://github.com/${REPO}/blob/main/${path}`;
|
||||
return `](${to}${id ? `#${id}` : ""})`;
|
||||
});
|
||||
}
|
||||
const docs = [];
|
||||
for (const { group, pages: slugs } of docsNav) {
|
||||
for (const slug of slugs) {
|
||||
const file = `${slug}.md`;
|
||||
const text = (await readFile(join(site, "docs", file), "utf8")).replace(/\r\n?/g, "\n");
|
||||
const api = slug === "api" || slug.startsWith("api/");
|
||||
const file = api ? apiSource(slug) : `website/docs/${slug}.md`;
|
||||
let text = (api ? (await repoFile(file))[0] : await readFile(join(site, "docs", `${slug}.md`), "utf8")).replace(/\r\n?/g, "\n");
|
||||
if (api) text = apiLinks(text.replace(/^<!--[\s\S]*?-->\n/, ""), file);
|
||||
const m = text.match(/^# (.+)\n\n((?:[^\n]+\n)+)\n/);
|
||||
if (!m) throw new Error(`docs/${file}: needs "# Title", a blank line, a lede paragraph and a blank line`);
|
||||
docs.push({ slug, file, group, title: m[1].trim(), lede: m[2].trim().replace(/\n/g, " "), body: text.slice(m[0].length), path: slug === "index" ? "/docs/" : `/docs/${slug}` });
|
||||
if (!m) throw new Error(`${file}: needs "# Title", a blank line, a lede paragraph and a blank line`);
|
||||
docs.push({ slug, file, group, title: m[1].replace(/`/g, "").trim(), lede: m[2].trim().replace(/\n/g, " "), body: text.slice(m[0].length), path: slug === "index" ? "/docs/" : `/docs/${slug}` });
|
||||
}
|
||||
}
|
||||
const plain = (md) => md.replace(/`/g, "").replace(/\[([^\]]+)\]\([^)]*\)/g, "$1").replace(/\*\*/g, "");
|
||||
@@ -352,7 +438,7 @@ const docNav = (current) =>
|
||||
.join("\n");
|
||||
const pagerLink = (d, rel) => (d ? `<a class="docs-pager-${rel}" href="${d.path}"><span>${rel === "next" ? "Next" : "Previous"}</span>${escape(d.title)}</a>` : "");
|
||||
|
||||
await mkdir(join(dist, "docs"), { recursive: true });
|
||||
await mkdir(join(dist, "docs", "api"), { recursive: true });
|
||||
const docPageFiles = [];
|
||||
const docPages = renderedDocs.map((d, i) => {
|
||||
const toc = d.headings.filter((h) => h.level === 2);
|
||||
@@ -374,8 +460,8 @@ const docPages = renderedDocs.map((d, i) => {
|
||||
};
|
||||
});
|
||||
|
||||
const pages = ["index.html", "404.html", "privacy.html", "releases.html", "benchmarks.html"];
|
||||
const currentPath = { "releases.html": "/releases", "benchmarks.html": "/benchmarks" };
|
||||
const pages = ["index.html", "404.html", "privacy.html", "releases.html", "benchmarks.html", "hub.html"];
|
||||
const currentPath = { "releases.html": "/releases", "benchmarks.html": "/benchmarks", "hub.html": "/hub" };
|
||||
for (const page of pages) {
|
||||
let html = await readFile(join(site, "src", page), "utf8");
|
||||
const own = { ...values, SITE_NAV: siteNav(currentPath[page]) };
|
||||
@@ -391,7 +477,7 @@ const modsTemplate = await readFile(join(site, "src", "mods.html"), "utf8");
|
||||
const modsList = ` <p class="kicker"><span>Mods</span>Made for Horizon, reviewed</p>
|
||||
<h1 class="display page-title">Horizon mods</h1>
|
||||
<p class="lede">Mods, modpacks and resource packs made for Horizon. Each one was reviewed before it was listed, and the launcher checks every file before it installs it. Mods run in a sandbox and can only do what their page says.</p>
|
||||
<p class="mod-actions"><a class="button primary" href="${SUBMIT}">Submit yours</a> <a class="button secondary" href="/docs/mods">Make a mod</a></p>
|
||||
<p class="mod-actions"><a class="button primary" href="${SUBMIT}">Submit yours</a> <a class="button secondary" href="/docs/make-a-mod">Make a mod</a></p>
|
||||
<div class="mod-tools">
|
||||
<input class="mod-search" id="mod-search" type="search" placeholder="Search" aria-label="Search the registry" autocomplete="off">
|
||||
<div class="release-filter" role="group" aria-label="Show">
|
||||
@@ -442,6 +528,12 @@ for (const { file, values: own } of docPages) {
|
||||
docPageFiles.push(file);
|
||||
}
|
||||
|
||||
// The roadmap for other readers (Kira, scripts): /data/roadmap.json, as tools/roadmap.py wrote it.
|
||||
await mkdir(join(dist, "data"), { recursive: true });
|
||||
await cp(join(site, "data", "roadmap.json"), join(dist, "data", "roadmap.json"));
|
||||
// The journal for Kira's #updates and its X posts: /data/journal.json, rebuilt with every deploy.
|
||||
await writeFile(join(dist, "data", "journal.json"), JSON.stringify(journalJson(releases, hubLive, roadmap), null, 1) + "\n");
|
||||
|
||||
// The pages' inline scripts (they mark the page as scripted and apply the saved theme before CSS
|
||||
// applies) and the inlined stylesheet: the Content-Security-Policy in the Caddyfile allows them by hash.
|
||||
const allHtml = (await Promise.all([...pages, ...docPageFiles, ...modPages.map((p) => p.file)].map((page) => readFile(join(dist, page), "utf8")))).join("\n");
|
||||
@@ -449,7 +541,7 @@ const hashes = (re) => [...new Set([...allHtml.matchAll(re)].map((m) => `'sha256
|
||||
await writeFile(join(dist, ".csp-script"), hashes(/<script>([\s\S]*?)<\/script>/g));
|
||||
await writeFile(join(dist, ".csp-style"), hashes(/<style>([\s\S]*?)<\/style>/g));
|
||||
|
||||
const urls = ["/", "/mods", ...modPages.slice(1).map((p) => p.path), "/releases", "/benchmarks", ...docs.map((d) => d.path), "/privacy"];
|
||||
const urls = ["/", "/hub", "/mods", ...modPages.slice(1).map((p) => p.path), "/releases", "/benchmarks", ...docs.map((d) => d.path), "/privacy"];
|
||||
await writeFile(
|
||||
join(dist, "sitemap.xml"),
|
||||
`<?xml version="1.0" encoding="UTF-8"?>\n<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">\n${urls.map((u) => ` <url><loc>https://playhorizon.dev${u}</loc></url>`).join("\n")}\n</urlset>\n`,
|
||||
@@ -457,5 +549,5 @@ await writeFile(
|
||||
|
||||
console.log(
|
||||
`built dist/ from ${readmeFrom}: ${body.length} subsystems, ${percent}, ${harnesses} harnesses, ` +
|
||||
`${ours.length} releases (${game.length} game)${launcher ? `, launcher ${launcher.tag_name}` : ""}, ${benchSummary.groups.length} benchmark rows, ${contributors.length} contributors, ${docs.length} docs pages, ${modProjects.length} registry projects`,
|
||||
`${ours.length} releases (${game.length} game)${launcher ? `, launcher ${launcher.tag_name}` : ""}, ${benchSummary.groups.length} benchmark rows, ${contributors.length} contributors, ${docs.length} docs pages, ${modProjects.length} registry projects, ${roadmap.items.length} roadmap items (${hubLinked.size}/${linked.size} links live), ${Object.values(board).flat().length} board cards, ${journal.length} journal entries`,
|
||||
);
|
||||
|
||||
@@ -0,0 +1,571 @@
|
||||
{
|
||||
"format": "horizon-roadmap",
|
||||
"version": 1,
|
||||
"source": "roadmap/roadmap.toml",
|
||||
"overview": {
|
||||
"today_plain": "Horizon is Minecraft: Java Edition 26.3 rewritten from scratch in Rust, so it runs faster on the same computer. Single player, LAN, servers, resource packs and Horizon's own mods work today, on your own copy of the game.",
|
||||
"today_dev": "A native Rust and wgpu reimplementation of Java 26.3: the same saves, rules and terrain, checked against the real game by more than 300 differential harnesses (a Java oracle and a Rust probe on the same inputs). Single player runs on its own server thread, like vanilla's integrated server.",
|
||||
"help_plain": "Play it and tell us what differs from vanilla (Discord or GitHub), run the benchmark on your computer, vote for what you want next, or pick one of the Help wanted items.",
|
||||
"help_dev": "Read CONTRIBUTING.md, pick a Help wanted item or a To do card, check vanilla's code for the behaviour, and paste the block `python3 tools/pr_ready.py` prints in your pull request."
|
||||
},
|
||||
"statuses": [
|
||||
{
|
||||
"id": "now",
|
||||
"name": "Now"
|
||||
},
|
||||
{
|
||||
"id": "next",
|
||||
"name": "Next"
|
||||
},
|
||||
{
|
||||
"id": "later",
|
||||
"name": "Later"
|
||||
},
|
||||
{
|
||||
"id": "help-wanted",
|
||||
"name": "Help wanted"
|
||||
},
|
||||
{
|
||||
"id": "shipped",
|
||||
"name": "Recently shipped"
|
||||
}
|
||||
],
|
||||
"areas": [
|
||||
{
|
||||
"id": "performance",
|
||||
"name": "Performance"
|
||||
},
|
||||
{
|
||||
"id": "modpacks",
|
||||
"name": "Modpacks"
|
||||
},
|
||||
{
|
||||
"id": "servers",
|
||||
"name": "Servers and multiplayer"
|
||||
},
|
||||
{
|
||||
"id": "mods",
|
||||
"name": "Mods and API"
|
||||
},
|
||||
{
|
||||
"id": "gameplay",
|
||||
"name": "Gameplay parity"
|
||||
},
|
||||
{
|
||||
"id": "rendering",
|
||||
"name": "Rendering"
|
||||
},
|
||||
{
|
||||
"id": "launcher",
|
||||
"name": "Launcher"
|
||||
},
|
||||
{
|
||||
"id": "extras",
|
||||
"name": "Horizon extras"
|
||||
},
|
||||
{
|
||||
"id": "project",
|
||||
"name": "Code and tools"
|
||||
}
|
||||
],
|
||||
"items": [
|
||||
{
|
||||
"id": "smooth-frames",
|
||||
"title": "Steady frames at long render distances",
|
||||
"status": "now",
|
||||
"area": "performance",
|
||||
"plain": "Making Horizon faster than vanilla on every computer, with smooth camera movement even at 32 chunks, by spreading the work better over the processor's cores.",
|
||||
"dev": "Frame pacing at render distance 32 (#678): long frames come from work competing with the render thread. In review: world generation workers build free structure starts instead of queueing them (#1760), the worker pool leaves one core as vanilla does (#1778), and the terrain vertex arena is read as storage where flat draws run (#1742). Still open: far terrain at 48 to 64 chunks (#718) and CPU-bound fields of block entities (#717). Every change shows before and after numbers from `tools/perf_bench.py` against vanilla 26.3 (docs/benchmark.md).",
|
||||
"links": [
|
||||
"#678",
|
||||
"#1760",
|
||||
"#1778",
|
||||
"#1742",
|
||||
"#718",
|
||||
"#717",
|
||||
"docs/benchmark.md"
|
||||
],
|
||||
"focus": true
|
||||
},
|
||||
{
|
||||
"id": "block-storage",
|
||||
"title": "Faster block lookups",
|
||||
"status": "now",
|
||||
"area": "performance",
|
||||
"plain": "Speeding up the code that reads and writes the blocks of the world, which almost everything in the game goes through: generation, lighting, meshing and ticking.",
|
||||
"dev": "`PalettedContainer` and `PackedStorage` find an entry's word by multiply and shift instead of an integer division (#1790, #1794); meshing looks up baked models by index, not by name (#1747). Each change keeps the paletted storage harnesses identical and shows its microbenchmark (docs/performance/paletted-container-access-results.md).",
|
||||
"links": [
|
||||
"#1790",
|
||||
"#1794",
|
||||
"#1747",
|
||||
"docs/performance/paletted-container-access-results.md"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "modpack-worldgen",
|
||||
"title": "Modpacks' world generation, natively",
|
||||
"status": "now",
|
||||
"area": "modpacks",
|
||||
"plain": "Making the world-generation mods of popular modpacks (new structures, YUNG's dungeons and mineshafts, packs built on Lithostitched) generate their worlds in Horizon, natively and fast.",
|
||||
"dev": "`horizon-port-pack` carries a pack's data-driven content over; structure mods that need code get a native port: YUNG's worldgen as written (#1746), Lithostitched's limited and guaranteed elements with pool and processor modifiers (#1777), its processors as the game's own types (#1765). Proved by the structure blocks and layout harnesses (#1753, #1757). Mods whose Java code does more than world generation don't run (docs/modpacks.md).",
|
||||
"links": [
|
||||
"#1746",
|
||||
"#1777",
|
||||
"#1765",
|
||||
"#1753",
|
||||
"#1757",
|
||||
"docs/modpacks.md"
|
||||
],
|
||||
"focus": true,
|
||||
"announce": true
|
||||
},
|
||||
{
|
||||
"id": "server-clients",
|
||||
"title": "Playing on servers: everything shows as it should",
|
||||
"status": "now",
|
||||
"area": "servers",
|
||||
"plain": "When you play on a server, other players, mobs, items and menus look and behave as in vanilla: skins, poses, item names, inventories and server networks.",
|
||||
"dev": "Client-of-a-server fixes in `game/remote*.rs` and `horizon-protocol`: mobs' aggressive and item-use flags (#1802, #1798), ghost items after a remote menu (#1795), skins (#1652), cookies and transfer packets for proxy networks (#1650), firework boosts (#1671), living-entity attributes and simulation distance (#1731), styled item names (#1702), primed TNT between updates (#1710).",
|
||||
"links": [
|
||||
"#1802",
|
||||
"#1798",
|
||||
"#1795",
|
||||
"#1652",
|
||||
"#1650",
|
||||
"#1671",
|
||||
"#1731",
|
||||
"#1702",
|
||||
"#1710"
|
||||
],
|
||||
"focus": true,
|
||||
"ongoing": true
|
||||
},
|
||||
{
|
||||
"id": "server-thread",
|
||||
"title": "Single player as a server: the last differences",
|
||||
"status": "now",
|
||||
"area": "gameplay",
|
||||
"plain": "Single player now runs a small server in the background, as vanilla does. We are fixing what still behaves differently there; every fix also works for LAN and server players.",
|
||||
"dev": "Since #1514 single player runs on the server thread (`game/integrated.rs`) and the window joins it as a client; `--in-frame` keeps the old path. The open `[server-thread]` issues list the gaps. In review: a tool that changes a block ends the click (#1797), potions keep their potion over the connection (#1796), mobs' aggression and arm swings (#1802). docs/server-levels.md.",
|
||||
"links": [
|
||||
"#1514",
|
||||
"#1797",
|
||||
"#1796",
|
||||
"#1802",
|
||||
"docs/server-levels.md"
|
||||
],
|
||||
"focus": true,
|
||||
"ongoing": true
|
||||
},
|
||||
{
|
||||
"id": "mod-registry",
|
||||
"title": "Horizon's mod registry",
|
||||
"status": "now",
|
||||
"area": "mods",
|
||||
"plain": "One place for mods, modpacks and resource packs made for Horizon: browse them on the website and install them from the launcher in one click.",
|
||||
"dev": "Merged: the registry index (schema 1, `.hpack`, checks before install, #1634), `cargo horizon-mod check` (#1642) and the submission service (`crates/horizon-mod-registry`, #1659). In review: the website's /mods (#1596) and /mods/submit (#1635), and in the launcher the registry as a source (#1636), install, enable and takedowns (#1637), the Mods page (#1638) and modpacks as their own profiles (#1640).",
|
||||
"links": [
|
||||
"#1634",
|
||||
"#1642",
|
||||
"#1659",
|
||||
"#1596",
|
||||
"#1635",
|
||||
"#1636",
|
||||
"#1637",
|
||||
"#1638",
|
||||
"#1640",
|
||||
"docs/mods.md"
|
||||
],
|
||||
"focus": true,
|
||||
"announce": true
|
||||
},
|
||||
{
|
||||
"id": "server-dialogs",
|
||||
"title": "Server dialogs and login screens",
|
||||
"status": "now",
|
||||
"area": "servers",
|
||||
"plain": "Servers that show dialogs, such as the register and login screens of AuthMe, will work in Horizon.",
|
||||
"dev": "26.3's dialog packets and model (#1720), the dialog screen with its buttons and actions (#1734), then text and boolean inputs (#1735).",
|
||||
"links": [
|
||||
"#1720",
|
||||
"#1734",
|
||||
"#1735"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "languages",
|
||||
"title": "Play in your language",
|
||||
"status": "now",
|
||||
"area": "gameplay",
|
||||
"plain": "Item names, container titles and server messages follow the language you pick, as in vanilla. Today parts of the game stay in English.",
|
||||
"dev": "Translatable components resolved through the selected language for items, containers and server text (#1806), on top of the bundled languages the prepared resources carry (#1594). Left: the client's own screens (#1672) and the main menu with zh_cn (#1774).",
|
||||
"links": [
|
||||
"#1806",
|
||||
"#1594",
|
||||
"#1672",
|
||||
"#1774"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "shader-packs",
|
||||
"title": "Shader packs, written again from scratch",
|
||||
"status": "now",
|
||||
"area": "rendering",
|
||||
"plain": "Shader packs were removed and are being rebuilt from scratch. They come back, off by default, once the best-known packs draw properly.",
|
||||
"dev": "A clean-room rewrite in `horizon-shaderpack`, from the packs' public format documentation only: reading packs, the preprocessor and `.properties` files are merged (#1584, #1585, #1586); translating programs to WGSL through naga, buffers, uniforms and the terrain, entity, sky, weather and hand stages are in review (#1698 to #1801).",
|
||||
"links": [
|
||||
"#1561",
|
||||
"#1584",
|
||||
"#1586",
|
||||
"#1698",
|
||||
"#1771",
|
||||
"#1786",
|
||||
"#1801"
|
||||
],
|
||||
"ongoing": true
|
||||
},
|
||||
{
|
||||
"id": "discord-presence",
|
||||
"title": "Discord Rich Presence",
|
||||
"status": "now",
|
||||
"area": "extras",
|
||||
"plain": "Your Discord profile can show that you are playing Horizon, with a switch to turn it off.",
|
||||
"dev": "A Discord IPC client on its own thread (#1787) and the presence with its setting (#1788). Merged: it ships with the next release.",
|
||||
"links": [
|
||||
"#1787",
|
||||
"#1788"
|
||||
],
|
||||
"announce": true
|
||||
},
|
||||
{
|
||||
"id": "lean-code",
|
||||
"title": "A leaner codebase that builds faster",
|
||||
"status": "now",
|
||||
"area": "project",
|
||||
"plain": "Cleaning up Horizon's code: removing what nothing uses and making it quicker to build, so fixes and new features land faster.",
|
||||
"dev": "A review of the whole tree: dead code and stubs removed (#1432, #1658), one probe binary per crate (#1453, #1454), shared harness helpers (#1448), clippy clean on the whole tree (#1707). docs/architecture.md maps each feature to its files and harnesses.",
|
||||
"links": [
|
||||
"#1432",
|
||||
"#1658",
|
||||
"#1453",
|
||||
"#1454",
|
||||
"#1448",
|
||||
"#1707",
|
||||
"docs/architecture.md"
|
||||
],
|
||||
"ongoing": true
|
||||
},
|
||||
{
|
||||
"id": "microsoft-sign-in",
|
||||
"title": "Microsoft sign-in (coming soon)",
|
||||
"status": "next",
|
||||
"area": "launcher",
|
||||
"plain": "Coming soon: sign in with your Microsoft account to play on online-mode servers. The code is ready; it waits for Microsoft's approval.",
|
||||
"dev": "Device-code sign-in in the launcher and online-mode login in the client (docs/microsoft-account.md). It is turned on by setting the app's client id once Minecraft API access is approved; until then the launcher shows \"Coming soon\".",
|
||||
"links": [
|
||||
"docs/microsoft-account.md",
|
||||
"#1270"
|
||||
],
|
||||
"announce": true
|
||||
},
|
||||
{
|
||||
"id": "curseforge",
|
||||
"title": "CurseForge in the mod browser (coming soon)",
|
||||
"status": "next",
|
||||
"area": "modpacks",
|
||||
"plain": "Coming soon: search and download CurseForge mods and modpacks from the launcher, as you can with Modrinth today.",
|
||||
"dev": "The mod browser lists CurseForge as coming soon (docs/mod-browser.md): it needs CurseForge API access. Meanwhile packs import from a CurseForge zip or instance folder, and jars only CurseForge hosts come from the player's own instance (docs/modpacks.md).",
|
||||
"links": [
|
||||
"docs/mod-browser.md",
|
||||
"docs/modpacks.md"
|
||||
],
|
||||
"announce": true
|
||||
},
|
||||
{
|
||||
"id": "benchmarks",
|
||||
"title": "Fresh benchmarks against vanilla",
|
||||
"status": "next",
|
||||
"area": "performance",
|
||||
"plain": "New public numbers comparing Horizon with vanilla on many kinds of computers, measured the same way every time, on the website's Benchmarks page.",
|
||||
"dev": "Redo the comparison after the current performance work (#1073); reliability, coverage and presentation (#1346); a scene must count as loaded only once its first chunk arrives (#1749). Players' reports come in through `--benchmark` and `horizon-launcher data benchmark` (docs/benchmark.md).",
|
||||
"links": [
|
||||
"#1073",
|
||||
"#1346",
|
||||
"#1749",
|
||||
"docs/benchmark.md"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "pistons-push",
|
||||
"title": "Pistons push players and mobs",
|
||||
"status": "next",
|
||||
"area": "gameplay",
|
||||
"plain": "Pistons and slime blocks will push players, mobs and items as in vanilla. Today moving blocks pass through them.",
|
||||
"dev": "Port `PistonMovingBlockEntity.moveCollidedEntities` and `moveStuckEntities` (honey), the slime bounce and `Entity.limitPistonMovement` for `MoverType.PISTON`, in single player and for a server's players. Issues #1496, #1609, #1608, #1704, #1758.",
|
||||
"links": [
|
||||
"#1496",
|
||||
"#1609",
|
||||
"#1608",
|
||||
"#1704",
|
||||
"#1758"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "intel-mac",
|
||||
"title": "Horizon on Intel Macs",
|
||||
"status": "next",
|
||||
"area": "launcher",
|
||||
"plain": "Builds of the game and the launcher for Macs with an Intel processor.",
|
||||
"dev": "x86_64 game and launcher builds, picked per processor (#1171). Before it ships it needs a run on a real Intel Mac: Rosetta on Apple Silicon only proves the CPU code. Requests: #1161, #1792.",
|
||||
"links": [
|
||||
"#1171",
|
||||
"#1161",
|
||||
"#1792"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "ai-companion",
|
||||
"title": "An optional AI teammate",
|
||||
"status": "later",
|
||||
"area": "extras",
|
||||
"plain": "An AI teammate that plays beside you and that you can talk to. It is off unless you turn it on, and the No AI switch hides it completely.",
|
||||
"dev": "Draft pull requests: the companion (#1068), its safety modes and their evaluation (#1069), and a route that finishes the game (#1070). Local models first; it ships only once the safety evaluation passes.",
|
||||
"links": [
|
||||
"#1068",
|
||||
"#1069",
|
||||
"#1070"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "new-versions",
|
||||
"title": "Following new Minecraft versions",
|
||||
"status": "later",
|
||||
"area": "gameplay",
|
||||
"plain": "When Mojang releases a new version of the game, Horizon follows it, and every system is checked against the new version again.",
|
||||
"dev": "The port pipeline detects a release, diffs its classes against 26.3 and writes a port report (docs/version-ports.md); the harnesses then run against the new version.",
|
||||
"links": [
|
||||
"docs/version-ports.md"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "benchmark-your-pc",
|
||||
"title": "Benchmark your computer",
|
||||
"status": "help-wanted",
|
||||
"area": "performance",
|
||||
"plain": "Run Horizon's built-in benchmark and share the report: every new computer makes the performance work more accurate. No coding needed.",
|
||||
"dev": "`horizon-launcher play --arg=--benchmark --arg=standard` writes a JSON report; `horizon-launcher data benchmark <report>` shows what would be sent and uploads it (website/docs/performance.md). Results from three installs with the same hardware appear on the Benchmarks page. Example: #1711.",
|
||||
"links": [
|
||||
"website/docs/performance.md",
|
||||
"#1711"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "end-city-banners",
|
||||
"title": "End city banners keep their pattern",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "Banners in End cities show as plain magenta instead of with their pattern.",
|
||||
"dev": "Compare the banner block entities the End city templates place with vanilla's (`EndCityPieces`, the templates' block entity NBT, `BannerBlockEntity`'s patterns), in `crates/horizon-world/src/worldgen/structure/`. Issue #1438; possibly related: #526.",
|
||||
"links": [
|
||||
"#1438",
|
||||
"#526"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "end-city-loot",
|
||||
"title": "Enchanted loot in End cities",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "Armour and tools in End city chests should come enchanted, as in vanilla.",
|
||||
"dev": "`loot.rs` implements `enchant_with_levels`: find why the End city chest table's rolls come out bare, and compare them with vanilla's for a few seeds. Issues #1437, #1660.",
|
||||
"links": [
|
||||
"#1437",
|
||||
"#1660"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "item-cooldowns",
|
||||
"title": "Cooldowns drawn on items",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "After you throw an ender pearl, its slot should show the cooldown sweeping away, as in vanilla.",
|
||||
"dev": "Vanilla draws `ItemCooldowns`' percent as a white overlay over the slot (`GuiGraphicsExtractor.itemDecorations` and `itemCooldown`) in the hotbar and in inventories. Issue #1763.",
|
||||
"links": [
|
||||
"#1763"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "chat-settings",
|
||||
"title": "Chat settings and team prefixes",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "The Hidden and Commands Only chat settings should hide chat, and team prefixes should appear before names in chat.",
|
||||
"dev": "Vanilla checks `ChatVisiblity` before it delivers chat and system messages (#1376), and chat uses the team-formatted display name (#1378). Both issues have exact steps to reproduce.",
|
||||
"links": [
|
||||
"#1376",
|
||||
"#1378"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "pointer-hand",
|
||||
"title": "A pointing hand over buttons",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "The mouse pointer should turn into a pointing hand over menu buttons, as in vanilla 26.3.",
|
||||
"dev": "26.3's `AbstractWidget` asks for a cursor from `CursorTypes` when it is hovered; winit's `CursorIcon::Pointer` gives the same shape. Issue #1347.",
|
||||
"links": [
|
||||
"#1347"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "text-field-keys",
|
||||
"title": "Ctrl+Backspace and scroll bars in menus",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "Ctrl+Backspace should delete a whole word in the creative search, and every list's scroll bar should be draggable.",
|
||||
"dev": "`EditBox` deletes by word with Ctrl (#1764); the Game Rules and Statistics lists' scroll bars can't be dragged (#1782, after #978).",
|
||||
"links": [
|
||||
"#1764",
|
||||
"#1782"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "chicken-flap",
|
||||
"title": "Chickens flap while they fall",
|
||||
"status": "help-wanted",
|
||||
"area": "gameplay",
|
||||
"plain": "Chickens should flap their wings while they fall, not stand still in the air.",
|
||||
"dev": "Vanilla's `Chicken.aiStep` updates `flap` and `flapSpeed` when the chicken isn't on the ground, and the model's wings follow them. Issue #1706.",
|
||||
"links": [
|
||||
"#1706"
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "server-resource-packs",
|
||||
"title": "Server resource packs",
|
||||
"status": "shipped",
|
||||
"area": "servers",
|
||||
"plain": "Servers can send you their resource pack: Horizon asks, downloads it and applies it, like vanilla.",
|
||||
"dev": "The dedicated server offers server.properties' pack (#1562); the client's pack manager, downloads, prompt and Server Resource Packs setting (#1569, #1570).",
|
||||
"links": [
|
||||
"#1562",
|
||||
"#1569",
|
||||
"#1570"
|
||||
],
|
||||
"shipped_in": "v0.2.48"
|
||||
},
|
||||
{
|
||||
"id": "server-thread-default",
|
||||
"title": "Single player on its own server thread",
|
||||
"status": "shipped",
|
||||
"area": "gameplay",
|
||||
"plain": "Single player runs on a server thread, as vanilla does, so the world keeps ticking smoothly while the window draws.",
|
||||
"dev": "`game/integrated.rs` runs a second `Game` with one level per dimension; the window joins it through memory like a LAN guest (#1514).",
|
||||
"links": [
|
||||
"#1514",
|
||||
"docs/server-levels.md"
|
||||
],
|
||||
"shipped_in": "v0.2.39"
|
||||
},
|
||||
{
|
||||
"id": "metal-occlusion",
|
||||
"title": "GPU occlusion culling on Macs",
|
||||
"status": "shipped",
|
||||
"area": "performance",
|
||||
"plain": "On Macs the GPU now skips terrain hidden behind hills and caves: 8 to 48% more frames per second at 32 chunks on an M4 Pro.",
|
||||
"dev": "GPU occlusion culling on Metal (#1434).",
|
||||
"links": [
|
||||
"#1434"
|
||||
],
|
||||
"shipped_in": "v0.2.17"
|
||||
},
|
||||
{
|
||||
"id": "gpu-animated-textures",
|
||||
"title": "Animated textures on the GPU",
|
||||
"status": "shipped",
|
||||
"area": "performance",
|
||||
"plain": "Water, lava and other animated blocks are now animated by the graphics card: 1.7 to 2.4 times better 1% lows on Intel graphics.",
|
||||
"dev": "Frames uploaded once, no per-tick CPU blend or copy (#1239).",
|
||||
"links": [
|
||||
"#1239"
|
||||
],
|
||||
"shipped_in": "v0.2.5"
|
||||
},
|
||||
{
|
||||
"id": "far-detail",
|
||||
"title": "Far Detail for integrated graphics",
|
||||
"status": "shipped",
|
||||
"area": "performance",
|
||||
"plain": "An optional Reduced setting for far terrain, suggested on integrated graphics, that saves 2 to 4 ms of GPU time per frame.",
|
||||
"dev": "Opt-in reduced far terrain (#1199), on far-terrain chunk summaries built on the workers (#1029).",
|
||||
"links": [
|
||||
"#1199",
|
||||
"#1029"
|
||||
],
|
||||
"shipped_in": "v0.2.5"
|
||||
},
|
||||
{
|
||||
"id": "mod-browser",
|
||||
"title": "The launcher's mod browser",
|
||||
"status": "shipped",
|
||||
"area": "modpacks",
|
||||
"plain": "Search Modrinth for mods, modpacks and resource packs from the launcher; it says before installing what works in Horizon.",
|
||||
"dev": "The Mods page (#1154), Java mods checked before install (#1242), project pages, filters and galleries (#1243), modpacks ported in the same step (#1246). docs/mod-browser.md.",
|
||||
"links": [
|
||||
"#1154",
|
||||
"#1242",
|
||||
"#1243",
|
||||
"#1246",
|
||||
"docs/mod-browser.md"
|
||||
],
|
||||
"shipped_in": "launcher@0.2.0"
|
||||
},
|
||||
{
|
||||
"id": "launcher-look",
|
||||
"title": "A blocky, Minecraft-like launcher",
|
||||
"status": "shipped",
|
||||
"area": "launcher",
|
||||
"plain": "The launcher got a new blocky look in Horizon's purple, in dark and light.",
|
||||
"dev": "The Blocks look (#1269), from `horizon-theme` (docs/design-system.md).",
|
||||
"links": [
|
||||
"#1269",
|
||||
"docs/design-system.md"
|
||||
],
|
||||
"shipped_in": "launcher@0.2.0"
|
||||
},
|
||||
{
|
||||
"id": "dynamic-lights",
|
||||
"title": "Dynamic lights",
|
||||
"status": "shipped",
|
||||
"area": "extras",
|
||||
"plain": "An optional extra: torches you hold, drop or set on fire light up what is around them.",
|
||||
"dev": "Held, dropped and burning light sources (#1162), in Horizon Extras, off by default.",
|
||||
"links": [
|
||||
"#1162"
|
||||
],
|
||||
"shipped_in": "v2026.10.22"
|
||||
},
|
||||
{
|
||||
"id": "servers-page",
|
||||
"title": "Host a server from the launcher",
|
||||
"status": "shipped",
|
||||
"area": "servers",
|
||||
"plain": "The launcher's Servers page creates, starts, backs up and updates a Horizon server with buttons, and invites friends.",
|
||||
"dev": "The launcher's Servers page (#1026) over `horizon-server` (docs/hosting.md).",
|
||||
"links": [
|
||||
"#1026",
|
||||
"docs/hosting.md"
|
||||
],
|
||||
"shipped_in": "launcher-v0.15.0"
|
||||
}
|
||||
],
|
||||
"journal": [
|
||||
{
|
||||
"week": "2026-43",
|
||||
"date": "2026-10-19",
|
||||
"title": "Single player becomes a server, servers send their packs",
|
||||
"plain": "Single player now runs on its own server thread, as vanilla does, and a run of fixes made shields, tridents, elytra, maps, fishing, signs and books work there and for every server player. Servers can send you their resource packs, the launcher got its blocky new look, and the first pieces of Horizon's mod registry landed. Shader packs were taken out, to come back written from scratch.",
|
||||
"dev": "The server thread became the default (#1514), after guests and server-thread players reached parity: totems (#1463), death drops (#1464), signs and books (#1465, #1466), shields, tridents, crossbows and spyglasses (#1476), elytra (#1475), maps (#1510), fishing (#1509), wind charges (#1508), strikes and mob effects (#1512), the cursor stack on close (#1513). Server resource packs: the dedicated server offers them (#1562) and the client downloads, asks and applies them (#1569, #1570). Mod registry: index schema 1 and `.hpack` (#1634), `cargo horizon-mod check` (#1642), the submission service (#1659). Shader packs were removed (#1561) and the clean-room rewrite started from the format's documentation (#1584 onward). Releases now ship in batches of five pull requests, or six hours after the oldest (#1554)."
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -1,4 +1,4 @@
|
||||
# Horizon's APIs
|
||||
# APIs at a glance
|
||||
|
||||
Horizon is built to be built on. Mods, shaders, agents, server panels, launchers' scripts and tools all get a documented API with a version, a stability level and a reference generated from the code, so it never says something the game doesn't do.
|
||||
|
||||
@@ -13,7 +13,7 @@ Horizon is built to be built on. Mods, shaders, agents, server panels, launchers
|
||||
| **Launcher** | your agent, pack makers | `horizon-launcher`'s 46 commands and its MCP server | preview |
|
||||
| **Data formats** | tools that read Horizon's files | benchmark reports, telemetry, settings, release checksums; worlds are vanilla's format | per format |
|
||||
|
||||
The full pages, one per surface, are in the repository: [docs/api](https://github.com/ludovic111/horizon/tree/main/docs/api). Mods for players: [Mods](/docs/mods). Agents: [Control Horizon with your AI agent](/docs/agents). Hosting: [Host a server](/docs/hosting).
|
||||
The full pages, one per surface, with their references: [the API portal](/docs/api), starting with [the Mod API](/docs/api/mods). Mods for players: [Mods](/docs/mods). Agents: [Control Horizon with your AI agent](/docs/agents). Hosting: [Host a server](/docs/hosting).
|
||||
|
||||
## What the levels mean
|
||||
|
||||
|
||||
@@ -0,0 +1,124 @@
|
||||
# Content mods
|
||||
|
||||
A content mod adds blocks and items to the game with data files only: no Rust, no compiler. Each new block or item copies a vanilla one (its template) and changes what differs, and comes with its recipes, loot table, tags, model, textures and name, in the same formats as vanilla's data packs and resource packs.
|
||||
|
||||
## What a content mod is
|
||||
|
||||
A folder (while you work on it) or a `.hmod` file (to share it) holding a manifest, `assets/` and `data/`. This is the SDK's [`ruby-content`](https://github.com/ludovic111/horizon/tree/main/crates/horizon-mod-sdk/examples/ruby-content) example, a ruby gem and a block of ruby:
|
||||
|
||||
```
|
||||
ruby/
|
||||
├── horizon-mod.toml
|
||||
├── data/ruby/horizon/block/ruby_block.json the block: a template and what differs
|
||||
├── data/ruby/horizon/item/ruby.json the item
|
||||
├── data/ruby/recipe/ruby_block.json recipes, as in a data pack
|
||||
├── data/ruby/recipe/ruby_from_ruby_block.json
|
||||
├── data/ruby/loot_table/blocks/ruby_block.json what the block drops
|
||||
├── data/minecraft/tags/block/mineable/pickaxe.json added to vanilla's tags
|
||||
├── data/minecraft/tags/block/needs_iron_tool.json
|
||||
├── assets/ruby/blockstates/ruby_block.json models and textures, as in a resource pack
|
||||
├── assets/ruby/models/block/ruby_block.json
|
||||
├── assets/ruby/models/item/ruby.json
|
||||
├── assets/ruby/items/ruby.json
|
||||
├── assets/ruby/items/ruby_block.json
|
||||
├── assets/ruby/textures/block/ruby_block.png
|
||||
├── assets/ruby/textures/item/ruby.png
|
||||
└── assets/ruby/lang/en_us.json the names players see
|
||||
```
|
||||
|
||||
Its manifest asks for API `0.2` and the `registries` capability. It has no code, so it needs no `Cargo.toml` and no `mod.wasm`:
|
||||
|
||||
```toml
|
||||
id = "ruby"
|
||||
name = "Ruby"
|
||||
version = "0.1.0"
|
||||
description = "A ruby gem and a block of ruby"
|
||||
authors = ["You"]
|
||||
api = "0.2"
|
||||
side = "both"
|
||||
capabilities = ["registries"]
|
||||
```
|
||||
|
||||
## Blocks
|
||||
|
||||
A block is a file `data/<id>/horizon/block/<name>.json`. It becomes the block `<id>:<name>`, with the template's behaviour, states and shapes:
|
||||
|
||||
```json
|
||||
{
|
||||
"template": "minecraft:iron_block",
|
||||
"properties": { "hardness": 4.0, "light": 3, "sounds": "minecraft:amethyst_block", "map_color": 28 }
|
||||
}
|
||||
```
|
||||
|
||||
| Key | Meaning |
|
||||
| --- | --- |
|
||||
| `template` | The vanilla block it copies, such as `minecraft:iron_block`, `minecraft:oak_door` or `minecraft:diamond_ore`. A door copies a door's states and shape, an ore an ore's. |
|
||||
| `properties.hardness` | How long it takes to mine (vanilla's destroy time; `-1` cannot be broken). |
|
||||
| `properties.explosion_resistance` | How well it stands up to explosions. |
|
||||
| `properties.light` | The light it gives, 0 to 15. |
|
||||
| `properties.requires_tool` | `true`: it drops nothing unless mined with the right tool (the tags say which). |
|
||||
| `properties.friction` | How slippery it is (ice is `0.98`). |
|
||||
| `properties.map_color` | Its colour on maps, a vanilla map colour id from 0 to 61. |
|
||||
| `properties.sounds` | A vanilla block whose sounds it uses. |
|
||||
| `item` | `false` for a block with no item. By default the block gets an item of the same id. |
|
||||
|
||||
Every property you leave out is the template's.
|
||||
|
||||
## Items
|
||||
|
||||
An item is a file `data/<id>/horizon/item/<name>.json`, copying a vanilla item:
|
||||
|
||||
```json
|
||||
{ "template": "minecraft:diamond", "rarity": "uncommon" }
|
||||
```
|
||||
|
||||
It may change `max_stack_size` (1 to 99) and `rarity` (`common`, `uncommon`, `rare` or `epic`, the colour of its name).
|
||||
|
||||
## Recipes, loot, tags, models and names
|
||||
|
||||
Everything else uses vanilla 26.3's own formats, so the [Minecraft Wiki's](https://minecraft.wiki/w/Data_pack) pages on data packs and resource packs apply:
|
||||
|
||||
- **Recipes** in `data/<id>/recipe/`, **loot tables** in `data/<id>/loot_table/`.
|
||||
- **Tags**: your own in `data/<id>/tags/`. To add to vanilla's (which pickaxe mines the block, for example), put a tag file in `data/minecraft/tags/`; to add to the convention tags NeoForge and Fabric mods share, in `data/c/tags/`. They add to the tag as a data pack does; `"replace": true` drops what came before it, and the log says so.
|
||||
- **Block states, models, item models and textures** in `assets/<id>/`, as in a resource pack. Models can use vanilla's parents, such as `minecraft:block/cube_all`.
|
||||
- **Names** in `assets/<id>/lang/en_us.json`: `"block.ruby.ruby_block": "Block of Ruby"`, `"item.ruby.ruby": "Ruby"`.
|
||||
|
||||
**Structures.** A content mod can also carry structures, template pools and structure sets in its namespace, and add its own pieces to vanilla's villages or to another mod's pools. The [mod design page](https://github.com/ludovic111/horizon/blob/main/docs/mods.md#content-mods-api-02) has the details.
|
||||
|
||||
## Namespaces
|
||||
|
||||
Your files go under your mod's id (`assets/ruby/`, `data/ruby/`), plus vanilla's and the convention tags (`data/minecraft/tags/`, `data/c/tags/`). Tags are the only files a mod may put under `minecraft`.
|
||||
|
||||
A mod made from a Java mod whose files use other names lists them in its manifest: `namespaces = ["kaisyn", "towns_and_towers"]`. A listed namespace is the mod's own, as its id is, but blocks and items are still declared under `data/<id>/horizon/`. `minecraft`, `c` and `horizon` can't be listed, and two mods that are on can't own the same namespace: the game keeps the first and logs the clash.
|
||||
|
||||
## Limits
|
||||
|
||||
- A mod's files use vanilla's resource-name characters: at most 65,536 files, 16 MiB each and 512 MiB in all.
|
||||
- A file the game can't read (a block model that doesn't parse, a recipe with a typo) is logged and skipped, as vanilla does: the rest of the mod still loads. Read the log while you work.
|
||||
- Unknown keys in a block or item file are refused, and the mod stays off with the reason on its row.
|
||||
- Content mods work in single player today. Playing them together on a server is planned.
|
||||
|
||||
## Start one
|
||||
|
||||
```sh
|
||||
cargo horizon-mod new my-blocks --template content
|
||||
```
|
||||
|
||||
makes a content mod with one block, Glowing Amethyst: an amethyst block that gives light, with its block state, model (using vanilla's amethyst texture), item model, name, loot table, a recipe (an amethyst block and glowstone dust) and the pickaxe tag. Rename and copy its files to add your own.
|
||||
|
||||
## Try it and share it
|
||||
|
||||
While you work, give the game the folder as a dev mod ([how](/docs/make-a-mod#see-it-in-the-game)): `--dev-mod "/path/to/ruby"`. The first start with a new set of mods takes a little longer while the game adds their content to its tables; after a change to the files, start the game again.
|
||||
|
||||
To share it, build the `.hmod` in the mod's folder:
|
||||
|
||||
```sh
|
||||
cargo horizon-mod build
|
||||
cargo horizon-mod check target/horizon-mod/ruby.hmod
|
||||
```
|
||||
|
||||
A folder without a `Cargo.toml` is a content mod: `build` checks its files as the game will and packs the manifest, `assets/` and `data/` into `target/horizon-mod/<id>.hmod`, with no compiler involved. `check` reads it as the registry does and says "no code: content only, nothing to run". Players put that file in their `horizon-mods` folder and turn it on in **Options, Mods...**, and you can [publish it](/docs/publish-a-mod) like any mod.
|
||||
|
||||
A mod can have both: a `Cargo.toml` with code, and `assets/` and `data/` with content. `build` packs both.
|
||||
|
||||
Next: [test it](/docs/test-a-mod).
|
||||
@@ -30,4 +30,5 @@ There is no build for Intel Macs, 32-bit systems, or ARM Linux and Windows. The
|
||||
- **Playing:** [install and first launch](/docs/install), [settings worth knowing](/docs/settings), [multiplayer](/docs/multiplayer) and [what to do when something breaks](/docs/troubleshooting).
|
||||
- **Hosting:** [host a server](/docs/hosting), from the launcher or the command line.
|
||||
- **Going further:** [modpacks](/docs/modpacks), [mods and data packs](/docs/mods) and [performance](/docs/performance).
|
||||
- **Making mods:** [make a mod](/docs/make-a-mod), from the first line of code to the registry, and the [Mod API](/docs/api/mods).
|
||||
- **Helping out:** [contribute](/docs/contributing) and the [FAQ](/docs/faq).
|
||||
|
||||
@@ -0,0 +1,88 @@
|
||||
# Make a mod
|
||||
|
||||
This guide takes you from nothing to a mod that other players can install from [playhorizon.dev/mods](/mods). You write the mod in Rust. It is compiled to WebAssembly and runs in a sandbox, so a player can see what it may do before turning it on. You need no Minecraft modding experience.
|
||||
|
||||
## The path
|
||||
|
||||
1. **Set up** (this page): install Rust and `cargo horizon-mod`, make your first mod and see it in the game.
|
||||
2. **[The manifest and capabilities](/docs/mod-manifest)**: the file that names your mod and lists what it may do.
|
||||
3. **[Write the code](/docs/mod-code)**: the hooks the game calls, what your code can call, and a worked example.
|
||||
4. **[Content mods](/docs/content-mods)**: blocks, items, recipes and textures from data files, with no code at all.
|
||||
5. **[Test it](/docs/test-a-mod)**: unit tests, the game's dev mode and the registry's own checks.
|
||||
6. **[Publish it](/docs/publish-a-mod)**: package, sign and submit it to the registry.
|
||||
|
||||
The [Mod API](/docs/api/mods) lists everything a mod can do today, and its [reference](/docs/api/mods-reference) has every function and type.
|
||||
|
||||
## What a mod can do today
|
||||
|
||||
- **Client mods** run in the player's game. They read what the F3 screen shows (position, facing, health, food, dimension, the time), draw a text panel on the screen, show chat lines only that player sees, add chat commands, and keep small files of their own. They work in single player and on any server, and a server cannot see them.
|
||||
- **Content mods** add blocks and items copied from vanilla templates, with their recipes, loot tables, tags, models, textures and names. They need no code.
|
||||
- **Server mods** (rules, world events, server commands) are being built. The [Mod API](/docs/api/mods#not-there-yet) says what comes next.
|
||||
|
||||
A Horizon mod is not a Java mod. Fabric, NeoForge and Forge jars don't run in Horizon, and Horizon mods don't run in Java Minecraft.
|
||||
|
||||
## Install the tools
|
||||
|
||||
You need [Rust](https://rustup.rs) (the stable toolchain), its WebAssembly target and `cargo horizon-mod`, the tool that makes, builds and checks mods. On Windows, macOS or Linux:
|
||||
|
||||
```sh
|
||||
rustup target add wasm32-unknown-unknown
|
||||
cargo install --git https://github.com/ludovic111/horizon cargo-horizon-mod
|
||||
```
|
||||
|
||||
The second command builds the tool from source, which takes a few minutes the first time. Run it again later to update the tool.
|
||||
|
||||
You also need Horizon itself, installed with the launcher ([Install](/docs/install)), and prepared at least once so the game has its files.
|
||||
|
||||
## Make your first mod
|
||||
|
||||
```sh
|
||||
cargo horizon-mod new my-mod
|
||||
cd my-mod
|
||||
```
|
||||
|
||||
`new` makes a folder with a working mod in it: a `/hello` command that answers in chat. `--name "My Mod"` sets the name players see, and `--template content` makes a [content mod](/docs/content-mods) instead, with no code. The folder holds:
|
||||
|
||||
```
|
||||
my-mod/
|
||||
├── Cargo.toml the Rust crate (a cdylib depending on horizon-mod-sdk)
|
||||
├── horizon-mod.toml the manifest: id, name, version, what the mod may do
|
||||
├── .gitignore
|
||||
└── src/lib.rs the code
|
||||
```
|
||||
|
||||
Build it:
|
||||
|
||||
```sh
|
||||
cargo horizon-mod build
|
||||
```
|
||||
|
||||
This compiles the crate, checks that the code uses nothing its manifest doesn't declare, and writes `target/horizon-mod/my_mod.hmod`. A `.hmod` is a zip file holding the manifest and the compiled code (`mod.wasm`). It is the one file you give players: the same file runs on Windows, macOS and Linux.
|
||||
|
||||
## See it in the game
|
||||
|
||||
A **dev mod** is a mod the game loads from a path you give it. It is always on, and the game looks at its file once a second: build again and the game reloads it, saying "Mods reloaded" in chat. Its memory starts over; what it saved to its storage stays.
|
||||
|
||||
**From the launcher.** Open the launcher's **Settings** and put this in **Game arguments**, with the full path to your file:
|
||||
|
||||
```
|
||||
--dev-mod "/path/to/my-mod/target/horizon-mod/my_mod.hmod"
|
||||
```
|
||||
|
||||
Then press **Play**, open a world and type `/hello world` in chat. Leave the setting there while you work on the mod, and clear it when you are done. The launcher's command line does the same: `horizon-launcher play --arg --dev-mod --arg /path/to/my_mod.hmod`.
|
||||
|
||||
**With `cargo horizon-mod run`.** If you have a `horizon-client` you built from source, `cargo horizon-mod run` builds the mod and starts that game with it. It looks for `horizon-client` on your `PATH`, or takes `--game <path>` or the `HORIZON_CLIENT` variable; anything after `--` goes to the game:
|
||||
|
||||
```sh
|
||||
cargo horizon-mod run --game ../horizon/target/fast/horizon-client -- --resources ../horizon/.local/horizon-client/26.3
|
||||
```
|
||||
|
||||
Either way, edit `src/lib.rs`, run `cargo horizon-mod build`, and the game picks up the new file.
|
||||
|
||||
## Where things go
|
||||
|
||||
- **Your mod's messages** go to the game log as `[mod my_mod] …` (the `logs/latest.log` file in the game folder), and the game prints them in its terminal too.
|
||||
- **Mods players install** go in the `horizon-mods` folder of the game folder (Linux `~/.local/share/horizon`, macOS `~/Library/Application Support/horizon`, Windows `%APPDATA%\horizon`). **Options, Mods...** in the game lists them, each with what it may do and a switch. They start off.
|
||||
- **A mod that fails** to load, or that breaks while running, is switched off with the reason in red on its row of the Mods screen. It never takes the game down with it.
|
||||
|
||||
Next: [the manifest and capabilities](/docs/mod-manifest).
|
||||
@@ -0,0 +1,190 @@
|
||||
# Write the code
|
||||
|
||||
A mod is a Rust type that implements the `Mod` trait from `horizon-mod-sdk`. The game calls its methods, the hooks, at fixed points, and the mod calls back into the game through the parts of the API its capabilities allow. This page explains both, then builds a complete mod step by step.
|
||||
|
||||
## The shape of a mod
|
||||
|
||||
```rust
|
||||
use horizon_mod_sdk::{Mod, Registration, chat};
|
||||
|
||||
struct Hello {
|
||||
greeted: u32,
|
||||
}
|
||||
|
||||
impl Mod for Hello {
|
||||
fn init() -> Result<(Self, Registration), String> {
|
||||
Ok((Hello { greeted: 0 }, Registration::new().command("hello")))
|
||||
}
|
||||
|
||||
fn command(&mut self, _name: &str, args: &str) -> Result<Option<String>, String> {
|
||||
self.greeted += 1;
|
||||
chat::show(&format!("Hello {args}! ({} so far)", self.greeted));
|
||||
Ok(None)
|
||||
}
|
||||
}
|
||||
|
||||
horizon_mod_sdk::export_mod!(Hello);
|
||||
```
|
||||
|
||||
- **The state lives in your type.** `init` creates it, and every hook gets `&mut self`.
|
||||
- **`export_mod!`** connects the type to the game. A mod has exactly one.
|
||||
- **The game calls only the hooks you ask for.** `init` returns a `Registration` that lists them. The other methods keep their default, empty bodies, and a hook you didn't ask for costs nothing.
|
||||
|
||||
## Hooks
|
||||
|
||||
| Hook | Ask for it with | When the game calls it |
|
||||
| --- | --- | --- |
|
||||
| `init() -> Result<(Self, Registration), String>` | always called | Once, when the mod loads. An `Err` keeps the mod off and shows the message on its row. |
|
||||
| `tick(&mut self, tick: u64)` | `.on_tick()` | Every game tick while the player is in a world: 20 times a second. |
|
||||
| `frame(&mut self, seconds: f32)` | `.on_frame()` | Every frame the game draws, with the time since the last one. |
|
||||
| `command(&mut self, name: &str, args: &str)` | `.command("name")` | When the player types `/name …` in chat. `args` is everything after the name. |
|
||||
| `chat(&mut self, text: &str)` | `.on_chat()` | For each chat line the player receives, as plain text. |
|
||||
|
||||
**Commands.** Ask for as many as you like with `.command("…")`, without the slash. The chat box colours them and completes them with Tab, like vanilla's commands. Vanilla's names win: a mod can't take `/give`, and when two mods ask for the same name, the first one loaded keeps it. The game logs both cases. The return value says what happens next:
|
||||
|
||||
- `Ok(None)`: nothing more. Use it when the mod already answered with `chat::show`.
|
||||
- `Ok(Some(text))`: the game shows `text` to the player.
|
||||
- `Err(text)`: the game shows `text` in red, as a failed command.
|
||||
|
||||
**Prefer ticks to frames.** A tick happens 20 times a second whatever the frame rate. The HUD panel is kept by the game and drawn every frame for you, so most mods never need `frame`.
|
||||
|
||||
## What your code can call
|
||||
|
||||
Each module of the SDK is one part of the API, and each needs its capability in the manifest ([the list](/docs/mod-manifest#capabilities)):
|
||||
|
||||
| Module | Capability | Calls |
|
||||
| --- | --- | --- |
|
||||
| `game` | `game-read` | `get_player() -> Option<Player>` (`x`, `y`, `z`, `yaw`, `pitch`, `health`, `food`, `dimension`), `get_clock() -> Option<Clock>` (`game_time`, `day_time`). `None` outside a world. |
|
||||
| `chat` | `chat` | `show(text)` |
|
||||
| `hud` | `hud` | `set_panel(Corner, &[Line])` (`Line { text, color }`, colour as `0xRRGGBB`; corners `TopLeft`, `TopRight`, `BottomLeft`, `BottomRight`), `clear()` |
|
||||
| `storage` | `storage` | `get(key) -> Option<Vec<u8>>`, `set(key, &[u8]) -> Result<(), String>`, `delete(key)` |
|
||||
| `log` | none | `horizon_mod_sdk::info(text)` and `warn(text)`: lines in the game log |
|
||||
|
||||
What the game reads for you (`game`) is a snapshot taken once a tick, and again before a command runs. It never changes in the middle of a call. Everything else is plain Rust: your own types, maths and text, and the crates you add to `Cargo.toml`, as long as they build for `wasm32-unknown-unknown` without the operating system (no files, threads, network or clock).
|
||||
|
||||
## A worked example: Playtime
|
||||
|
||||
This mod counts how long you play, shows it in the top-right corner, and keeps the count when you quit. `/playtime` says it in chat; `/playtime hide`, `show` and `reset` do what they say. It uses three capabilities (`hud`, `chat`, `storage`) and two hooks (`tick`, `command`).
|
||||
|
||||
**1. Make the mod.**
|
||||
|
||||
```sh
|
||||
cargo horizon-mod new playtime --name "Playtime"
|
||||
cd playtime
|
||||
```
|
||||
|
||||
**2. Declare what it may do.** In `horizon-mod.toml`, set the description and the capabilities:
|
||||
|
||||
```toml
|
||||
description = "How long you have played, in a corner of the screen"
|
||||
capabilities = ["hud", "chat", "storage"]
|
||||
```
|
||||
|
||||
**3. The state and a helper.** Replace `src/lib.rs` with the code below, in parts. First the imports, the state and a function that turns ticks into hours and minutes. It touches no API, so an ordinary unit test can check it (step 7).
|
||||
|
||||
```rust
|
||||
use horizon_mod_sdk::{
|
||||
Mod, Registration, chat,
|
||||
hud::{self, Corner, Line},
|
||||
storage,
|
||||
};
|
||||
|
||||
/// Ticks played, kept across sessions in the mod's storage.
|
||||
struct Playtime {
|
||||
ticks: u64,
|
||||
shown: bool,
|
||||
}
|
||||
|
||||
/// `1h 05m` from a number of ticks (20 a second).
|
||||
fn format(ticks: u64) -> String {
|
||||
let minutes = ticks / 20 / 60;
|
||||
format!("{}h {:02}m", minutes / 60, minutes % 60)
|
||||
}
|
||||
```
|
||||
|
||||
**4. Saving and drawing.** `storage::set` writes bytes under a key of your choice; it can fail when the mod is over its quota, so the error goes to the log. The panel is set once and the game draws it until it changes, so redraw only when there is something new to show.
|
||||
|
||||
```rust
|
||||
impl Playtime {
|
||||
fn save(&self) {
|
||||
if let Err(e) = storage::set("ticks", &self.ticks.to_le_bytes()) {
|
||||
horizon_mod_sdk::warn(&format!("could not save: {e}"));
|
||||
}
|
||||
}
|
||||
|
||||
fn draw(&self) {
|
||||
if self.shown {
|
||||
let line = Line { text: format!("Played {}", format(self.ticks)), color: 0xFFFF55 };
|
||||
hud::set_panel(Corner::TopRight, &[line]);
|
||||
} else {
|
||||
hud::clear();
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
**5. The hooks.** `init` reads what an earlier session saved, draws the panel and asks for one command and the tick hook. `tick` counts, and once a minute redraws and saves. `command` reads its arguments.
|
||||
|
||||
```rust
|
||||
impl Mod for Playtime {
|
||||
fn init() -> Result<(Self, Registration), String> {
|
||||
// What an earlier session saved, or 0 the first time.
|
||||
let ticks = storage::get("ticks")
|
||||
.and_then(|bytes| bytes.try_into().ok())
|
||||
.map_or(0, u64::from_le_bytes);
|
||||
let state = Playtime { ticks, shown: true };
|
||||
state.draw();
|
||||
Ok((state, Registration::new().command("playtime").on_tick()))
|
||||
}
|
||||
|
||||
fn tick(&mut self, _tick: u64) {
|
||||
self.ticks += 1;
|
||||
// Once a minute: redraw the panel and save.
|
||||
if self.ticks % (20 * 60) == 0 {
|
||||
self.draw();
|
||||
self.save();
|
||||
}
|
||||
}
|
||||
|
||||
fn command(&mut self, _name: &str, args: &str) -> Result<Option<String>, String> {
|
||||
match args.trim() {
|
||||
"" => chat::show(&format!("You have played {}", format(self.ticks))),
|
||||
"hide" | "show" => {
|
||||
self.shown = args.trim() == "show";
|
||||
self.draw();
|
||||
}
|
||||
"reset" => {
|
||||
self.ticks = 0;
|
||||
self.save();
|
||||
self.draw();
|
||||
return Ok(Some("Playtime reset".into()));
|
||||
}
|
||||
other => return Err(format!("Unknown option {other}: use hide, show or reset")),
|
||||
}
|
||||
Ok(None)
|
||||
}
|
||||
}
|
||||
|
||||
horizon_mod_sdk::export_mod!(Playtime);
|
||||
```
|
||||
|
||||
**6. Try it.** `cargo horizon-mod build`, then start the game with it as a dev mod ([how](/docs/make-a-mod#see-it-in-the-game)). Open a world: "Played 0h 00m" sits in the top-right corner and goes up each minute. Type `/playtime`, then `/playtime hide`. `/playtime foo` answers in red. Quit and come back: the count goes on from where it was.
|
||||
|
||||
**7. Test the helper.** At the end of `src/lib.rs`:
|
||||
|
||||
```rust
|
||||
#[cfg(test)]
|
||||
mod tests {
|
||||
#[test]
|
||||
fn formats_hours_and_minutes() {
|
||||
assert_eq!(super::format(0), "0h 00m");
|
||||
assert_eq!(super::format(20 * 60 * 65), "1h 05m");
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
`cargo test` runs it on your computer, with no game. [Test it](/docs/test-a-mod) covers the rest.
|
||||
|
||||
**Where to go from here.** The SDK's examples are complete mods to read: [`coords-hud`](https://github.com/ludovic111/horizon/tree/main/crates/horizon-mod-sdk/examples/coords-hud) (coordinates, facing and the time on the HUD, `/where` and `/coords`) and [`ruby-content`](https://github.com/ludovic111/horizon/tree/main/crates/horizon-mod-sdk/examples/ruby-content) (a content mod). The [reference](/docs/api/mods-reference) lists every type and function, with its limits.
|
||||
|
||||
Next: [content mods](/docs/content-mods), or straight to [testing](/docs/test-a-mod) if your mod has no blocks or items.
|
||||
@@ -0,0 +1,60 @@
|
||||
# The manifest and capabilities
|
||||
|
||||
Every mod has a `horizon-mod.toml` at its root. It names the mod, says which version of the mod API it was made for, and lists its capabilities: what it may do. Players read that list before they turn the mod on, and the game holds the mod to it.
|
||||
|
||||
## The manifest
|
||||
|
||||
```toml
|
||||
id = "playtime"
|
||||
name = "Playtime"
|
||||
version = "0.1.0"
|
||||
description = "How long you have played, in a corner of the screen"
|
||||
authors = ["You"]
|
||||
api = "0.1"
|
||||
side = "client"
|
||||
capabilities = ["hud", "chat", "storage"]
|
||||
```
|
||||
|
||||
| Key | What it is |
|
||||
| --- | --- |
|
||||
| `id` | The mod's id: 1 to 64 characters of `a-z`, `0-9` and `_`. It names the mod's setting, its log lines, its storage folder and, for content, its namespace. Keep it once you have published the mod. |
|
||||
| `name` | The name players see. |
|
||||
| `version` | Your mod's version, such as `0.1.0`. Each version you publish needs a new one. |
|
||||
| `description` | One or two sentences for the Mods screen. |
|
||||
| `authors` | A list of names. |
|
||||
| `api` | The mod API line the mod was made for: `"0.1"` for code, `"0.2"` for content. The game refuses a line it doesn't serve, with a message that says so. |
|
||||
| `side` | `"client"` for a mod that runs in the player's game. Content mods use `"both"`. |
|
||||
| `capabilities` | What the mod may do: the list below. |
|
||||
| `namespaces` | Content mods only: extra namespaces the mod's files use (see [Content mods](/docs/content-mods#namespaces)). |
|
||||
|
||||
Unknown keys are refused, so a typo is an error, not a permission that silently does nothing.
|
||||
|
||||
## Capabilities
|
||||
|
||||
A capability is a part of the API the mod may use. Each one shows on the Mods screen as a sentence that starts with "May". Writing to the game log needs no capability.
|
||||
|
||||
| Capability | The player reads | What the code can do |
|
||||
| --- | --- | --- |
|
||||
| `game-read` | May see your position, health and the time | `game::get_player()`: position, facing (yaw and pitch), health, food and dimension. `game::get_clock()`: the game time and the time of day. |
|
||||
| `chat` | May show you chat messages | `chat::show(text)`: a chat line only this player sees, after the mod's name. At most 8 per call into the mod. |
|
||||
| `hud` | May draw text on your screen | `hud::set_panel(corner, lines)` and `hud::clear()`: a panel of up to 16 coloured lines of 256 characters in one corner. The game keeps drawing it until you change it. |
|
||||
| `storage` | May save its own settings to disk | `storage::get`, `set` and `delete`: small files in a folder of the mod's own. Up to 64 files and 4 MiB in all, and at most 1 MiB written per call. Keys are 1 to 64 characters of `a-z`, `0-9`, `_`, `.` and `-`. |
|
||||
| `registries` | May add blocks and items to your worlds | Content mods: blocks and items from the mod's data files. No code. |
|
||||
|
||||
Ask only for what the mod uses: players are more likely to turn on a mod that asks for little.
|
||||
|
||||
**The game checks.** When you build, and again when a game loads the mod, the compiled code's imports are compared with the manifest. A mod whose code calls `chat::show` without `chat` in its capabilities is refused (`uses capability chat, missing from horizon-mod.toml`). The list players read is what the code can do, not a promise.
|
||||
|
||||
## What no mod can do
|
||||
|
||||
A mod runs in a WebAssembly sandbox. Whatever its capabilities:
|
||||
|
||||
- It cannot open files (apart from its own storage), the network, other programs or the clock.
|
||||
- It sees the game only through the snapshot the game gives it once a tick, and changes it only through the calls above. It cannot patch the game's code.
|
||||
- It has 64 MiB of memory and a time budget for each call. A mod that runs past its budget, runs out of memory or crashes is switched off, with the reason on its row of the Mods screen. The game goes on.
|
||||
|
||||
## API versions
|
||||
|
||||
The mod API is versioned apart from the game. A mod made for API `0.1` keeps loading on every game that serves `0.1`, and new functions arrive as additions. A change that would break mods comes as a new line, served beside the old one for at least one release cycle. The [stability page](/docs/api/stability) has the whole policy, and the [Mod API's changelog](/docs/api/mods#changelog) what each line added.
|
||||
|
||||
Next: [write the code](/docs/mod-code).
|
||||
@@ -6,7 +6,7 @@ Horizon has its own mod system, written for Horizon and not compatible with Java
|
||||
|
||||
Horizon mods are written in Rust, compiled to WebAssembly and run in a sandbox. A mod can only do what it asks for and you allow, and a mod that crashes is switched off without taking the game down.
|
||||
|
||||
> **Early.** The mod system is new. There is no store for Horizon mods yet: they are files to put in a folder. The launcher's **Mods** page (see below) finds resource packs and modpacks, not `.hmod` mods.
|
||||
> **Early.** The mod system is new. Reviewed mods are listed at [playhorizon.dev/mods](/mods), and any `.hmod` file can be put in the folder by hand.
|
||||
|
||||
**Playing with mods**
|
||||
|
||||
@@ -22,15 +22,17 @@ Horizon mods are written in Rust, compiled to WebAssembly and run in a sandbox.
|
||||
|
||||
**Making a mod**
|
||||
|
||||
[Make a mod](/docs/make-a-mod) is the full guide: the tools, your first mod in the game, the manifest and capabilities, the code with a worked example, content mods, testing, and publishing on [the registry](/mods). In short:
|
||||
|
||||
```sh
|
||||
rustup target add wasm32-unknown-unknown
|
||||
cargo install --git https://github.com/ludovic111/horizon cargo-horizon-mod
|
||||
cargo horizon-mod new my-mod
|
||||
cd my-mod
|
||||
cargo horizon-mod run
|
||||
cargo horizon-mod build
|
||||
```
|
||||
|
||||
`run` builds the mod and starts the game with it. After an edit, `cargo horizon-mod build` rebuilds it and the running game reloads it. The full guide, with the API, the manifest and the roadmap, is [docs/mods.md](https://github.com/ludovic111/horizon/blob/main/docs/mods.md). Java mod jars don't run in Horizon: their code calls and patches Minecraft's Java classes, and Horizon has none. What carries over is the data and assets inside a jar ([modpacks](https://github.com/ludovic111/horizon/blob/main/docs/modpacks.md)).
|
||||
The [Mod API](/docs/api/mods) lists what a mod can do today and what comes next, and its [reference](/docs/api/mods-reference) every function. Java mod jars don't run in Horizon: their code calls and patches Minecraft's Java classes, and Horizon has none. What carries over is the data and assets inside a jar ([modpacks](/docs/modpacks)).
|
||||
|
||||
## Finding resource packs and modpacks
|
||||
|
||||
|
||||
@@ -3,6 +3,8 @@
|
||||
{ "group": "Playing", "pages": ["settings", "multiplayer", "troubleshooting"] },
|
||||
{ "group": "Hosting", "pages": ["hosting"] },
|
||||
{ "group": "Going further", "pages": ["modpacks", "mods", "performance", "agents"] },
|
||||
{ "group": "Build on Horizon", "pages": ["apis"] },
|
||||
{ "group": "Make a mod", "pages": ["make-a-mod", "mod-manifest", "mod-code", "content-mods", "test-a-mod", "publish-a-mod"] },
|
||||
{ "group": "Build on Horizon", "pages": ["apis", "api", "api/stability"] },
|
||||
{ "group": "API reference", "pages": ["api/mods", "api/mods-reference", "api/mod-index", "api/server", "api/server-reference", "api/agent-control", "api/launcher", "api/data-formats", "api/shaders"] },
|
||||
{ "group": "Project", "pages": ["contributing", "faq"] }
|
||||
]
|
||||
|
||||
@@ -0,0 +1,57 @@
|
||||
# Publish a mod
|
||||
|
||||
Horizon's registry lists mods, modpacks and resource packs made for Horizon. Players find them at [playhorizon.dev/mods](/mods) and on the launcher's Mods page, which checks every file before it installs it. Each project is reviewed by a person before it is published. This page takes your mod from a file on your computer to the registry.
|
||||
|
||||
## Before you submit
|
||||
|
||||
1. **Choose a version.** Set `version` in `horizon-mod.toml` (such as `1.0.0`). Every version you publish needs a new one, and a published file never changes.
|
||||
2. **Build it for release.** `cargo horizon-mod build` (release is the default; `--debug` is for quick local builds) writes `target/horizon-mod/<id>.hmod`. That file is what you submit.
|
||||
3. **Check it.** `cargo horizon-mod check target/horizon-mod/<id>.hmod` must pass ([Test a mod](/docs/test-a-mod#check-it-as-the-registry-does)).
|
||||
4. **Publish the source.** Put the mod's source in a public repository, under a licence that lets players use it (MIT, Apache-2.0, GPL and so on, as an [SPDX](https://spdx.org/licenses/) name). Reviewers read it, and the file must be built from it.
|
||||
|
||||
## Sign it
|
||||
|
||||
Signing is optional and recommended. When your project has a public key, every later version must be signed with the matching secret key, so nobody else can publish an update in your name, even with access to your GitHub account.
|
||||
|
||||
Horizon uses [minisign](https://jedisct1.github.io/minisign/) signatures. Install minisign (`brew install minisign`, `scoop install minisign`, or your Linux distribution's package), then make a key pair once:
|
||||
|
||||
```sh
|
||||
minisign -G -p horizon-mods.pub -s horizon-mods.key
|
||||
```
|
||||
|
||||
Keep `horizon-mods.key` and its password private and backed up: losing it means changing the project's key by hand, through the registry's maintainers. The public key is the last line of `horizon-mods.pub` (it starts with `RW`).
|
||||
|
||||
Sign each file you publish, and check the signature as the registry will:
|
||||
|
||||
```sh
|
||||
minisign -S -s horizon-mods.key -m target/horizon-mod/playtime.hmod
|
||||
cargo horizon-mod check target/horizon-mod/playtime.hmod --key "RW…your public key…" --signature target/horizon-mod/playtime.hmod.minisig
|
||||
```
|
||||
|
||||
The report then says "signature verified".
|
||||
|
||||
## Submit it
|
||||
|
||||
Open [playhorizon.dev/mods/submit](/mods/submit) and sign in with GitHub. The page reads only your public profile. Then fill in:
|
||||
|
||||
- **The file**: the kind (mod), the `.hmod`, its id (the manifest's `id`), its version, the Minecraft version (26.3) and what changed.
|
||||
- **Its page**: the name, a one-line summary for the list, a description (Markdown), the authors, the licence, the source address and, optionally, a square PNG icon (at most 256 KiB).
|
||||
- **Signature**: your public key (for a new project) and the file's `.minisig`.
|
||||
|
||||
**Submit for review** checks the file again and opens a pull request in [ludovic111/horizon-mods](https://github.com/ludovic111/horizon-mods). It adds `mods/<id>.toml`, with you as the project's owner. The repository's checks run the file in the sandbox and post their report on the pull request.
|
||||
|
||||
## Review and publication
|
||||
|
||||
A reviewer reads the pull request, your source and the checks' report. Questions and requests for changes come as comments on the pull request: answer them there, and submit a new version from the form when the file must change.
|
||||
|
||||
When the reviewer merges it, the file becomes a release of horizon-mods within minutes, and the project gets its page at `playhorizon.dev/mods/<id>` and shows in the launcher. The page lists what the mod may do, as the game's Mods screen does, with your source, licence and the file's SHA-256.
|
||||
|
||||
## Updates
|
||||
|
||||
An update is the same form with a new version: it adds the version to your project's entry. The project's owners publish updates without a reviewer's extra look, and if the project has a key, the new file must be signed with it.
|
||||
|
||||
Without the form, you can open the pull request by hand: the [horizon-mods README](https://github.com/ludovic111/horizon-mods) says how. The registry's file formats are in [the mod index reference](/docs/api/mod-index).
|
||||
|
||||
## Reports and takedowns
|
||||
|
||||
Anyone can report a project from its page (**Report it**). A project that does harm is taken down: the launcher then refuses its files and turns installed copies off, telling players why.
|
||||
@@ -0,0 +1,59 @@
|
||||
# Test a mod
|
||||
|
||||
Three kinds of checks catch most mistakes before players see them: unit tests for your own logic, the game's dev mode for how the mod looks and feels, and `cargo horizon-mod check`, which runs the same checks as the registry.
|
||||
|
||||
## Unit tests for your logic
|
||||
|
||||
Code that doesn't call the game (formatting, maths, parsing a command's arguments) is ordinary Rust. Put it in plain functions and test it with `#[test]`, as the [Playtime example](/docs/mod-code#a-worked-example-playtime) does with its `format` function:
|
||||
|
||||
```sh
|
||||
cargo test
|
||||
```
|
||||
|
||||
The tests run on your computer, with no game and no WebAssembly. Keeping the hooks thin and the logic in functions makes most of a mod testable this way.
|
||||
|
||||
## In the game, as a dev mod
|
||||
|
||||
Start the game with your mod as a dev mod ([how](/docs/make-a-mod#see-it-in-the-game)) and keep it running. After each edit:
|
||||
|
||||
```sh
|
||||
cargo horizon-mod build
|
||||
```
|
||||
|
||||
The game sees the new file within a second, says "Mods reloaded" in chat and starts the mod over. What it saved with `storage` stays. Things to try each time:
|
||||
|
||||
- Every command, with no arguments, with good ones and with wrong ones. An `Err` should say what to type instead.
|
||||
- Leaving the world and opening another: `game::get_player()` is `None` on the title screen.
|
||||
- Quitting and starting again, for a mod that saves.
|
||||
- **Options, Mods...**: the mod's row lists what it may do. If it says the mod stopped, the reason is there.
|
||||
|
||||
The game log (`logs/latest.log` in the game folder) has your mod's `info` and `warn` lines as `[mod <id>]`, and the reason when the game refused or stopped the mod.
|
||||
|
||||
**Why a mod stops.** A mod that panics, runs past its time budget for one call (an endless loop, for example) or uses more than 64 MiB of memory is switched off. The rest of the game carries on. Fix the cause and build again: a dev mod starts over with the new file.
|
||||
|
||||
## Check it as the registry does
|
||||
|
||||
Before you publish, run what the registry runs on every submission:
|
||||
|
||||
```sh
|
||||
cargo horizon-mod check target/horizon-mod/playtime.hmod
|
||||
```
|
||||
|
||||
```
|
||||
playtime 0.1.0 (mod, API 0.1, client)
|
||||
12424 bytes, SHA-256 6561…ac13, unsigned
|
||||
may draw text on your screen
|
||||
may show you chat messages
|
||||
may save its own settings to disk
|
||||
trial run: started, 40 ticks, 120 frames, a chat line, /playtime: ok
|
||||
```
|
||||
|
||||
It reads the manifest, refuses code that uses a capability the manifest doesn't list, then plays the mod in the sandbox, as the game does: 40 ticks with a moving player, 120 frames, a chat line and each of its commands once with no arguments. The mod must start and must never crash or overrun its budget. It fails with the reason when one of those goes wrong.
|
||||
|
||||
- `--json` prints the report as JSON, for scripts.
|
||||
- `--key <public key> --signature <file>.minisig` also checks your signature ([Publish](/docs/publish-a-mod#sign-it)).
|
||||
- It checks modpacks (`.hpack`) and resource packs (`.zip`) too; `--kind mod|modpack|resourcepack` when the file's extension doesn't say which.
|
||||
|
||||
A mod that passes `check` passes the registry's automatic checks. A person still reviews it (see [Publish](/docs/publish-a-mod)).
|
||||
|
||||
Next: [publish it](/docs/publish-a-mod).
|
||||
@@ -3,7 +3,7 @@
|
||||
"build": {
|
||||
"builder": "DOCKERFILE",
|
||||
"dockerfilePath": "Dockerfile",
|
||||
"watchPatterns": ["/website/**", "/README.md", "/launcher/links.json"]
|
||||
"watchPatterns": ["/website/**", "/README.md", "/launcher/links.json", "/docs/api/**"]
|
||||
},
|
||||
"deploy": {
|
||||
"healthcheckPath": "/",
|
||||
|
||||
+10
-1
@@ -11,14 +11,23 @@ const port = Number(process.env.PORT) || 4173;
|
||||
|
||||
createServer(async (req, res) => {
|
||||
let path = normalize(decodeURIComponent(new URL(req.url, "http://x").pathname)).replace(/^(\.\.[/\\])+/, "");
|
||||
if (path === "/docs/api/") {
|
||||
res.writeHead(301, { Location: "/docs/api" });
|
||||
return res.end();
|
||||
}
|
||||
if (path.endsWith("/")) path += "index.html";
|
||||
// The server guide is part of the docs now, as the Caddyfile redirects it.
|
||||
if (path === "/server" || path === "/server.html") {
|
||||
res.writeHead(301, { Location: "/docs/hosting" });
|
||||
return res.end();
|
||||
}
|
||||
// The roadmap page became the hub's Roadmap tab.
|
||||
if (path === "/roadmap") {
|
||||
res.writeHead(301, { Location: "/hub#roadmap" });
|
||||
return res.end();
|
||||
}
|
||||
if (path === "/docs") path = "/docs/index.html";
|
||||
// /privacy and /docs/<page> are .html files, as the Caddyfile rewrites them.
|
||||
// /privacy, /docs/<page> and /docs/api/<page> are .html files, as the Caddyfile rewrites them.
|
||||
if (!extname(path)) path += ".html";
|
||||
let file = join(root, path);
|
||||
let status = 200;
|
||||
|
||||
@@ -21,7 +21,7 @@ export function contributorsFrom(list) {
|
||||
}
|
||||
|
||||
// GitHub serves avatars at any size: 96 px is twice what the page draws, for sharp screens.
|
||||
function avatar(url) {
|
||||
export function avatar(url) {
|
||||
if (!url.startsWith(AVATARS)) return "";
|
||||
const u = new URL(url);
|
||||
u.searchParams.set("s", "96");
|
||||
|
||||
@@ -46,7 +46,7 @@
|
||||
<nav class="docs-pager" aria-label="Next and previous pages">
|
||||
{{DOC_PAGER}}
|
||||
</nav>
|
||||
<p class="docs-edit"><a href="https://github.com/ludovic111/horizon/blob/main/website/docs/{{DOC_FILE}}">Edit this page on GitHub</a> · Spotted something wrong? <a href="https://github.com/ludovic111/horizon/issues">Open an issue</a> or ask on <a href="{{DISCORD}}">Discord</a>.</p>
|
||||
<p class="docs-edit"><a href="https://github.com/ludovic111/horizon/blob/main/{{DOC_FILE}}">Edit this page on GitHub</a> · Spotted something wrong? <a href="https://github.com/ludovic111/horizon/issues">Open an issue</a> or ask on <a href="{{DISCORD}}">Discord</a>.</p>
|
||||
<p class="disclaimer">Not an official Minecraft product. Not approved by or associated with Mojang or Microsoft.</p>
|
||||
</main>
|
||||
</div>
|
||||
|
||||
@@ -0,0 +1,270 @@
|
||||
// The hub page (/hub): its tabs (one per #hash, so /hub#roadmap and /hub#<item id> can be linked), the
|
||||
// Simple / Technical switch (remembered in localStorage), the area filter, and the live state of every
|
||||
// linked issue and pull request, refreshed from GitHub's public API. Without JavaScript, every tab reads
|
||||
// one after the other with what was baked at build time.
|
||||
import { cached, get, setUpMenu, setUpTheme } from "./chrome.js";
|
||||
import { REPO, boardFilterHtml, boardFrom, boardHtml, journalFrom, journalHtml, overviewHtml, roadmapHtml, slimIssue } from "./hub.js";
|
||||
|
||||
const root = document.documentElement;
|
||||
const data = JSON.parse(document.getElementById("hub-data").textContent);
|
||||
const tabs = [...document.querySelectorAll('.hub-tabs [role="tab"]')];
|
||||
const pill = document.querySelector(".hub-tabs .tab-pill");
|
||||
let area = "all";
|
||||
|
||||
// --- Tabs ------------------------------------------------------------------------------------------------------
|
||||
|
||||
const panelOf = (tab) => document.getElementById(tab.getAttribute("aria-controls"));
|
||||
const place = (tab) => {
|
||||
pill.style.width = `${tab.offsetWidth}px`;
|
||||
pill.style.height = `${tab.offsetHeight}px`;
|
||||
pill.style.transform = `translate(${tab.offsetLeft}px, ${tab.offsetTop}px)`;
|
||||
};
|
||||
function choose(tab, { focus = false, push = false } = {}) {
|
||||
for (const t of tabs) {
|
||||
const on = t === tab;
|
||||
t.setAttribute("aria-selected", String(on));
|
||||
t.tabIndex = on ? 0 : -1;
|
||||
panelOf(t).classList.toggle("is-active", on);
|
||||
}
|
||||
place(tab);
|
||||
if (focus) tab.focus();
|
||||
if (push && location.hash !== `#${panelOf(tab).id}`) history.replaceState(null, "", `#${panelOf(tab).id}`);
|
||||
}
|
||||
// "#roadmap" opens its tab; "#<item id>" or "#help-wanted" opens the tab holding it and scrolls there.
|
||||
function follow() {
|
||||
const target = location.hash && document.getElementById(decodeURIComponent(location.hash.slice(1)));
|
||||
const tab = tabs.find((t) => target && (panelOf(t) === target || panelOf(t).contains(target))) || tabs[0];
|
||||
choose(tab);
|
||||
if (target && target !== panelOf(tab)) {
|
||||
if (target.dataset.area && area !== "all" && target.dataset.area !== area) filter("all");
|
||||
requestAnimationFrame(() => target.scrollIntoView({ block: "start" }));
|
||||
}
|
||||
}
|
||||
tabs.forEach((tab, i) => {
|
||||
tab.addEventListener("click", () => choose(tab, { push: true }));
|
||||
tab.addEventListener("keydown", (e) => {
|
||||
const step = { ArrowRight: 1, ArrowLeft: -1 }[e.key];
|
||||
if (step) choose(tabs[(i + step + tabs.length) % tabs.length], { focus: true, push: true });
|
||||
});
|
||||
});
|
||||
// Links inside the page ("Help wanted", an item of the overview) switch tabs through the hash.
|
||||
addEventListener("hashchange", follow);
|
||||
addEventListener("resize", () => place(tabs.find((t) => t.getAttribute("aria-selected") === "true")));
|
||||
document.fonts?.ready.then(() => place(tabs.find((t) => t.getAttribute("aria-selected") === "true")));
|
||||
|
||||
// --- Simple / Technical ----------------------------------------------------------------------------------------
|
||||
|
||||
const detailButtons = [...document.querySelectorAll("[data-detail]")];
|
||||
function detail(mode) {
|
||||
if (mode === "dev") root.dataset.detail = "dev";
|
||||
else delete root.dataset.detail;
|
||||
detailButtons.forEach((b) => b.setAttribute("aria-pressed", String(b.dataset.detail === mode)));
|
||||
}
|
||||
detailButtons.forEach((b) =>
|
||||
b.addEventListener("click", () => {
|
||||
detail(b.dataset.detail);
|
||||
try {
|
||||
localStorage.setItem("hub:detail", b.dataset.detail);
|
||||
} catch {}
|
||||
}),
|
||||
);
|
||||
detail(root.dataset.detail === "dev" ? "dev" : "plain");
|
||||
|
||||
// --- Area filter -----------------------------------------------------------------------------------------------
|
||||
|
||||
const areaButtons = [...document.querySelectorAll("[data-area-filter]")];
|
||||
function filter(to) {
|
||||
area = to;
|
||||
areaButtons.forEach((b) => b.setAttribute("aria-pressed", String(b.dataset.areaFilter === area)));
|
||||
for (const section of document.querySelectorAll("[data-roadmap] .hub-section")) {
|
||||
let shown = 0;
|
||||
for (const item of section.querySelectorAll(".hub-item")) {
|
||||
item.hidden = area !== "all" && item.dataset.area !== area;
|
||||
if (!item.hidden) shown++;
|
||||
}
|
||||
section.hidden = shown === 0;
|
||||
}
|
||||
}
|
||||
areaButtons.forEach((b) => b.addEventListener("click", () => filter(b.dataset.areaFilter)));
|
||||
|
||||
// --- The board: a roadmap item's cards, and the long columns' "Show more" ----------------------------------------
|
||||
|
||||
const boardSelect = document.querySelector("[data-board-item]");
|
||||
function showItem() {
|
||||
const want = boardSelect.value;
|
||||
for (const card of document.querySelectorAll("[data-board] .hub-card")) {
|
||||
card.hidden = want === "-" ? !card.dataset.item : want ? card.dataset.item !== want : false;
|
||||
}
|
||||
for (const column of document.querySelectorAll("[data-board] .hub-column")) {
|
||||
column.querySelector("[data-count]").textContent = column.querySelectorAll(".hub-card:not([hidden])").length;
|
||||
// A filtered column shows all its cards.
|
||||
column.classList.toggle("is-open", Boolean(want) || column.classList.contains("was-opened"));
|
||||
}
|
||||
}
|
||||
boardSelect?.addEventListener("change", showItem);
|
||||
document.querySelector("[data-board]")?.addEventListener("click", (e) => {
|
||||
const button = e.target.closest("[data-more-button]");
|
||||
if (!button) return;
|
||||
button.closest(".hub-column").classList.add("is-open", "was-opened");
|
||||
button.remove();
|
||||
});
|
||||
|
||||
// --- Live state from GitHub ------------------------------------------------------------------------------------
|
||||
|
||||
// The open issues and pull requests, and those closed or merged lately: four requests at most, kept ten minutes.
|
||||
async function loadLive() {
|
||||
const list = [];
|
||||
for (let page = 1; page <= 3; page++) {
|
||||
const batch = await get(`https://api.github.com/repos/${REPO}/issues?state=open&per_page=100&page=${page}`);
|
||||
list.push(...batch.map(slimIssue));
|
||||
if (batch.length < 100) break;
|
||||
}
|
||||
const closed = await get(`https://api.github.com/repos/${REPO}/issues?state=closed&sort=updated&direction=desc&per_page=100`);
|
||||
return list.concat(closed.map(slimIssue));
|
||||
}
|
||||
const loadReleases = () => get(`https://api.github.com/repos/${REPO}/releases?per_page=40`);
|
||||
|
||||
async function refresh() {
|
||||
const fresh = await cached("horizon:hub-live", loadLive).catch(() => null);
|
||||
if (!fresh) return;
|
||||
// What the build knew about older links stays; GitHub's answer wins for the rest.
|
||||
const live = new Map([...data.live, ...fresh].map((i) => [i.n, i]));
|
||||
document.querySelector("[data-overview]").innerHTML = overviewHtml(data.roadmap, live);
|
||||
document.querySelector("[data-roadmap]").innerHTML = roadmapHtml(data.roadmap, live);
|
||||
filter(area);
|
||||
showVotes();
|
||||
const board = boardFrom(fresh, data.roadmap);
|
||||
const chosen = boardSelect.value;
|
||||
boardSelect.innerHTML = boardFilterHtml(board, data.roadmap);
|
||||
boardSelect.value = [...boardSelect.options].some((o) => o.value === chosen) ? chosen : "";
|
||||
document.querySelector("[data-board]").innerHTML = boardHtml(board, data.roadmap);
|
||||
showItem();
|
||||
const releases = await cached("horizon:hub-releases", loadReleases).catch(() => null);
|
||||
if (releases) document.querySelector("[data-journal]").innerHTML = journalHtml(journalFrom(releases, fresh, data.roadmap), data.roadmap);
|
||||
const note = document.querySelector("[data-live-note]");
|
||||
if (note) note.textContent = "Pull request and issue states are live from GitHub.";
|
||||
}
|
||||
|
||||
// --- Votes, bug reports and suggestions: the hub's server (crates/horizon-telemetry-server) --------------------
|
||||
|
||||
const saved = (key, fallback) => {
|
||||
try {
|
||||
return JSON.parse(localStorage.getItem(key)) ?? fallback;
|
||||
} catch {
|
||||
return fallback;
|
||||
}
|
||||
};
|
||||
const save = (key, value) => {
|
||||
try {
|
||||
localStorage.setItem(key, JSON.stringify(value));
|
||||
} catch {}
|
||||
};
|
||||
const post = (path, body) => fetch(`${data.api}${path}`, { method: "POST", headers: { "content-type": "application/json" }, body: JSON.stringify(body) });
|
||||
|
||||
// This browser's random id (one vote per item per browser) and the items it voted for. Nothing else identifies it.
|
||||
function voter() {
|
||||
let id = saved("hub:voter", "");
|
||||
if (typeof id !== "string" || id.length < 16) {
|
||||
id = crypto.randomUUID ? crypto.randomUUID() : [...crypto.getRandomValues(new Uint8Array(16))].map((b) => b.toString(16).padStart(2, "0")).join("");
|
||||
save("hub:voter", id);
|
||||
}
|
||||
return id;
|
||||
}
|
||||
const mine = new Set(saved("hub:voted", []));
|
||||
let counts = null; // { item: votes } once the server answered; until then the buttons stay hidden
|
||||
|
||||
function showVotes() {
|
||||
if (!counts) return;
|
||||
for (const button of document.querySelectorAll("[data-vote]")) {
|
||||
const id = button.dataset.vote;
|
||||
button.hidden = false;
|
||||
button.setAttribute("aria-pressed", String(mine.has(id)));
|
||||
button.querySelector(".hub-vote-label").textContent = mine.has(id) ? "Wanted" : "Want it";
|
||||
button.querySelector("[data-votes]").textContent = counts[id] ? String(counts[id]) : "";
|
||||
}
|
||||
}
|
||||
|
||||
async function vote(id) {
|
||||
const up = !mine.has(id);
|
||||
const apply = (on, step) => {
|
||||
if (on) mine.add(id);
|
||||
else mine.delete(id);
|
||||
counts[id] = Math.max(0, (counts[id] || 0) + step);
|
||||
save("hub:voted", [...mine]);
|
||||
showVotes();
|
||||
};
|
||||
apply(up, up ? 1 : -1);
|
||||
try {
|
||||
const res = await post("/hub/vote", { item: id, voter: voter(), up });
|
||||
if (!res.ok) throw new Error(res.status);
|
||||
counts[id] = (await res.json()).votes;
|
||||
showVotes();
|
||||
} catch {
|
||||
apply(!up, up ? -1 : 1);
|
||||
}
|
||||
}
|
||||
document.addEventListener("click", (e) => {
|
||||
const button = e.target.closest("[data-vote]");
|
||||
if (button && counts) vote(button.dataset.vote);
|
||||
});
|
||||
|
||||
const LABELS = { title: "the title", did: "what you did", happened: "what happened", expected: "what you expected", version: "the version", system: "OS, CPU, GPU", text: "your idea", name: "your name" };
|
||||
// The server's answer in words: "did: 3 to 2000 characters" becomes "Check what you did: 3 to 2000 characters."
|
||||
function trouble(code, answer) {
|
||||
if (code === 429) return "Too many sent from your connection: try again in a few minutes.";
|
||||
const said = typeof answer.error === "string" ? answer.error : "";
|
||||
const field = said.match(/^(\w+): (.+)$/);
|
||||
if (code === 400 && field) return `Check ${LABELS[field[1]] || field[1]}: ${field[2]}.`;
|
||||
return said ? `${said[0].toUpperCase()}${said.slice(1)}.` : "That didn't go through: try again in a moment.";
|
||||
}
|
||||
|
||||
function setUpForm(form, path, thanks) {
|
||||
const status = form.querySelector("[data-status]");
|
||||
form.hidden = false;
|
||||
form.parentElement.querySelector("[data-closed]").hidden = true;
|
||||
form.addEventListener("submit", async (e) => {
|
||||
e.preventDefault();
|
||||
if (!form.reportValidity()) return;
|
||||
const button = form.querySelector('[type="submit"]');
|
||||
button.disabled = true;
|
||||
status.textContent = "Sending…";
|
||||
try {
|
||||
const res = await post(path, Object.fromEntries(new FormData(form)));
|
||||
const answer = await res.json().catch(() => ({}));
|
||||
if (res.ok) {
|
||||
thanks(status, answer);
|
||||
// A new report starts with the version filled in again; the name stays for the next one.
|
||||
for (const field of form.querySelectorAll("textarea, input:not([name='version']):not([name='name'])")) field.value = "";
|
||||
} else status.textContent = trouble(res.status, answer);
|
||||
} catch {
|
||||
status.textContent = "Couldn't reach the server: try again, or use GitHub or Discord.";
|
||||
}
|
||||
button.disabled = false;
|
||||
});
|
||||
}
|
||||
|
||||
// The forms and the votes show once the server answers; without it the page points to GitHub and Discord.
|
||||
async function connect() {
|
||||
try {
|
||||
// Revalidated: the server keeps the counts a minute, a browser's copy would miss this browser's own vote.
|
||||
const res = await fetch(`${data.api}/hub/votes`, { cache: "no-cache" });
|
||||
if (!res.ok) return;
|
||||
counts = (await res.json()).votes || {};
|
||||
} catch {
|
||||
return;
|
||||
}
|
||||
showVotes();
|
||||
setUpForm(document.querySelector('[data-form="report"]'), "/hub/report", (status, answer) => {
|
||||
const issue = typeof answer.issue === "string" && answer.issue.match(/^https:\/\/github\.com\/ludovic111\/horizon\/issues\/(\d+)$/);
|
||||
status.innerHTML = issue ? `Thanks! It's <a href="${issue[0]}">issue #${issue[1]}</a> on GitHub: follow it there.` : "Thanks! It will be on GitHub in a few minutes.";
|
||||
});
|
||||
setUpForm(document.querySelector('[data-form="suggest"]'), "/hub/suggest", (status) => {
|
||||
status.textContent = "Thanks! The maintainers read every suggestion.";
|
||||
});
|
||||
}
|
||||
|
||||
setUpTheme();
|
||||
setUpMenu();
|
||||
connect();
|
||||
follow();
|
||||
refresh().then(() => data.roadmap.items.some((i) => `#${i.id}` === location.hash) && follow());
|
||||
@@ -0,0 +1,170 @@
|
||||
<!doctype html>
|
||||
<html lang="en" class="no-js">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1, viewport-fit=cover">
|
||||
<title>Hub · Horizon</title>
|
||||
<meta name="description" content="Where Horizon is: what is being done now, what comes next, what shipped, and how to help, in plain words or in technical detail.">
|
||||
<meta name="theme-color" content="#ece7f7" media="(prefers-color-scheme: light)">
|
||||
<meta name="theme-color" content="#0f0d17" media="(prefers-color-scheme: dark)">
|
||||
<meta name="color-scheme" content="light dark">
|
||||
<link rel="canonical" href="https://playhorizon.dev/hub">
|
||||
<link rel="icon" href="/favicon.svg" type="image/svg+xml">
|
||||
<link rel="icon" href="/favicon-32.png" sizes="32x32" type="image/png">
|
||||
<link rel="apple-touch-icon" href="/apple-touch-icon.png">
|
||||
<meta property="og:type" content="website">
|
||||
<meta property="og:site_name" content="Horizon">
|
||||
<meta property="og:title" content="Hub · Horizon">
|
||||
<meta property="og:description" content="What is being done on Horizon now, what comes next, what shipped, and how to help.">
|
||||
<meta property="og:url" content="https://playhorizon.dev/hub">
|
||||
<meta property="og:image" content="https://playhorizon.dev/og.png">
|
||||
<link rel="preconnect" href="https://api.github.com" crossorigin>
|
||||
<style>{{STYLE}}</style>
|
||||
<script>document.documentElement.classList.replace("no-js", "js"); try { const t = localStorage.getItem("theme"); if (t === "light" || t === "dark") document.documentElement.dataset.theme = t; if (localStorage.getItem("hub:detail") === "dev") document.documentElement.dataset.detail = "dev" } catch {}</script>
|
||||
<script type="module" src="{{HUB_JS}}"></script>
|
||||
</head>
|
||||
<body class="subpage">
|
||||
<a class="skip" href="#main">Skip to the content</a>
|
||||
{{SITE_NAV}}
|
||||
<main id="main" class="section page-main hub">
|
||||
<div class="container">
|
||||
<p class="kicker"><span>Hub</span>Now, next and how to help</p>
|
||||
<h1 class="display page-title">Where Horizon is going</h1>
|
||||
<p class="lede">What is being done, what comes next, what shipped and where you can help. No dates: things are Now, Next or Later. Read it in plain words, or switch to the technical picture.</p>
|
||||
<div class="hub-bar">
|
||||
<div class="tabs hub-tabs" role="tablist" aria-label="Hub">
|
||||
<span class="tab-pill" aria-hidden="true"></span>
|
||||
<button type="button" role="tab" id="tab-overview" aria-controls="overview" aria-selected="true">Overview</button>
|
||||
<button type="button" role="tab" id="tab-roadmap" aria-controls="roadmap" aria-selected="false" tabindex="-1">Roadmap</button>
|
||||
<button type="button" role="tab" id="tab-board" aria-controls="board" aria-selected="false" tabindex="-1">Kanban</button>
|
||||
<button type="button" role="tab" id="tab-journal" aria-controls="journal" aria-selected="false" tabindex="-1">Journal</button>
|
||||
<button type="button" role="tab" id="tab-contribute" aria-controls="contribute" aria-selected="false" tabindex="-1">Contribute</button>
|
||||
</div>
|
||||
<div class="hub-detail" role="group" aria-label="Detail">
|
||||
<button type="button" class="button secondary small" data-detail="plain" aria-pressed="true">Simple</button>
|
||||
<button type="button" class="button secondary small" data-detail="dev" aria-pressed="false">Technical</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="hub-panel is-active" role="tabpanel" id="overview" aria-labelledby="tab-overview" data-overview>
|
||||
{{HUB_OVERVIEW}}
|
||||
</div>
|
||||
|
||||
<div class="hub-panel" role="tabpanel" id="roadmap" aria-labelledby="tab-roadmap">
|
||||
<div class="release-filter hub-areas" role="group" aria-label="Area">
|
||||
{{HUB_AREAS}}
|
||||
</div>
|
||||
<div data-roadmap>
|
||||
{{HUB_ROADMAP}}
|
||||
</div>
|
||||
<p class="meta hub-source">The roadmap lives in the repository: <a href="https://github.com/ludovic111/horizon/blob/main/ROADMAP.md">ROADMAP.md</a>, generated from <a href="https://github.com/ludovic111/horizon/blob/main/roadmap/roadmap.toml">roadmap/roadmap.toml</a>. Pull requests carry the <code>roadmap:<id></code> label of their item. <span data-live-note></span></p>
|
||||
</div>
|
||||
|
||||
<div class="hub-panel" role="tabpanel" id="board" aria-labelledby="tab-board">
|
||||
<div class="hub-board-head">
|
||||
<p class="hub-intro">Every open issue and pull request, placed by its state on GitHub, as on Kira's work board in Discord.</p>
|
||||
<label class="hub-select"><span class="meta">Show</span><select data-board-item>{{HUB_BOARD_FILTER}}</select></label>
|
||||
</div>
|
||||
<div class="hub-board" data-board>
|
||||
{{HUB_BOARD}}
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="hub-panel" role="tabpanel" id="journal" aria-labelledby="tab-journal">
|
||||
<p class="hub-intro">Every release with what it changed, grouped by roadmap item in Technical, and a summary of each week. Also as <a href="/data/journal.json">journal.json</a>.</p>
|
||||
<div class="hub-journal" data-journal>
|
||||
{{HUB_JOURNAL}}
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="hub-panel" role="tabpanel" id="contribute" aria-labelledby="tab-contribute">
|
||||
<section class="hub-block" aria-labelledby="h-first">
|
||||
<h2 class="title" id="h-first">Good first tasks</h2>
|
||||
<p class="hub-plain hub-intro">Each one is a small difference from vanilla, with an issue that says how to see it.</p>
|
||||
<p class="hub-dev hub-intro">Each links its issue; the technical text says where in the code and in vanilla to start.</p>
|
||||
<ol class="index hub-rows">{{HUB_HELP_WANTED}}</ol>
|
||||
</section>
|
||||
<section class="hub-block" aria-labelledby="h-ways">
|
||||
<h2 class="title" id="h-ways">Ways to help</h2>
|
||||
<div class="hub-cards">
|
||||
<article class="highlight">
|
||||
<h3>Tell us what differs</h3>
|
||||
<p>Something that doesn't play like vanilla is a bug. Say what you did, what happened and what vanilla does, with your Horizon version and system.</p>
|
||||
<p class="hub-actions"><a class="button secondary small" href="#report">Report a bug</a><a class="button secondary small" href="#suggest">Suggest something</a></p>
|
||||
</article>
|
||||
<article class="highlight">
|
||||
<h3>Take a task</h3>
|
||||
<p>Pick a good first task or an open issue. On Discord, <code>/claim 1234</code> tells everyone you are on issue 1234, so nobody starts the same work; <code>/unclaim</code> frees it.</p>
|
||||
<p class="hub-actions"><a class="button secondary small" href="https://github.com/ludovic111/horizon/issues">Open issues</a></p>
|
||||
</article>
|
||||
<article class="highlight">
|
||||
<h3>Bring your AI agent</h3>
|
||||
<p>On Discord, <code>/agent connect</code> gives your coding agent a personal token for Kira's MCP server: it reads the work board, claims tasks and posts its progress in your name.</p>
|
||||
<p class="hub-actions"><a class="button secondary small" href="{{DISCORD}}">Join the Discord</a></p>
|
||||
</article>
|
||||
<article class="highlight">
|
||||
<h3>Benchmark your computer</h3>
|
||||
<p>Run the built-in benchmark and share the report: every new machine makes the performance work more accurate. No coding needed.</p>
|
||||
<p class="hub-actions"><a class="button secondary small" href="/docs/performance">How to</a></p>
|
||||
</article>
|
||||
</div>
|
||||
</section>
|
||||
<section class="hub-block" id="report" aria-labelledby="h-report">
|
||||
<h2 class="title" id="h-report">Report a bug</h2>
|
||||
<p class="hub-intro">One bug per report: something that breaks, or doesn't play like vanilla. It becomes an issue on GitHub, public, and you get its link to follow it. Search the <a href="https://github.com/ludovic111/horizon/issues?q=is%3Aissue+label%3Abug">open bugs</a> first.</p>
|
||||
<form class="hub-form" data-form="report" hidden>
|
||||
<label class="hub-field"><span>Title: what is broken, in a few words</span><input name="title" required minlength="5" maxlength="120" autocomplete="off" placeholder="Water looks black on AMD graphics"></label>
|
||||
<label class="hub-field"><span>What did you do? The steps, one per line</span><textarea name="did" required minlength="3" maxlength="2000" rows="4"></textarea></label>
|
||||
<div class="hub-form-pair">
|
||||
<label class="hub-field"><span>What happened?</span><textarea name="happened" required minlength="3" maxlength="2000" rows="3"></textarea></label>
|
||||
<label class="hub-field"><span>What did you expect? What vanilla does</span><textarea name="expected" required minlength="3" maxlength="2000" rows="3"></textarea></label>
|
||||
</div>
|
||||
<div class="hub-form-pair">
|
||||
<label class="hub-field"><span>Horizon version</span><input name="version" maxlength="60" value="{{HUB_VERSION}}" autocomplete="off"></label>
|
||||
<label class="hub-field"><span>OS, CPU, GPU</span><input name="system" required minlength="3" maxlength="200" placeholder="Windows 11, Ryzen 5 5600, RX 6600"></label>
|
||||
</div>
|
||||
<label class="hub-field"><span>Your name, shown on the issue (optional)</span><input name="name" maxlength="64" autocomplete="nickname"></label>
|
||||
<label class="hub-trap" aria-hidden="true">Leave this empty <input name="website" tabindex="-1" autocomplete="off"></label>
|
||||
<p class="hub-form-foot"><button type="submit" class="button primary">Send the report</button><span class="meta" data-status role="status"></span></p>
|
||||
<p class="meta">What you write is public on GitHub: no passwords or personal details. A screenshot or the log file helps: add it to the issue once it's open.</p>
|
||||
</form>
|
||||
<p class="hub-form-closed" data-closed>Report it on <a href="https://github.com/ludovic111/horizon/issues/new">GitHub</a> or in <a href="{{DISCORD}}">#horizon-bugs on Discord</a>, where Kira turns your post into an issue.</p>
|
||||
</section>
|
||||
<section class="hub-block" id="suggest" aria-labelledby="h-suggest">
|
||||
<h2 class="title" id="h-suggest">Suggest something</h2>
|
||||
<p class="hub-intro">An idea for Horizon, or about something on the roadmap. The maintainers read every one, and the good ones become roadmap items. Nothing you send here is published.</p>
|
||||
<form class="hub-form" data-form="suggest" hidden>
|
||||
<label class="hub-field"><span>Your idea</span><textarea name="text" required minlength="10" maxlength="1000" rows="4"></textarea></label>
|
||||
<div class="hub-form-pair">
|
||||
<label class="hub-field"><span>About</span><select name="item">{{HUB_SUGGEST_ITEMS}}</select></label>
|
||||
<label class="hub-field"><span>Your name (optional)</span><input name="name" maxlength="64" autocomplete="nickname"></label>
|
||||
</div>
|
||||
<label class="hub-trap" aria-hidden="true">Leave this empty <input name="website" tabindex="-1" autocomplete="off"></label>
|
||||
<p class="hub-form-foot"><button type="submit" class="button primary">Send the idea</button><span class="meta" data-status role="status"></span></p>
|
||||
</form>
|
||||
<p class="hub-form-closed" data-closed>Post it in <a href="{{DISCORD}}">#horizon-ideas on Discord</a>, or send it to Kira with <code>/suggest</code>.</p>
|
||||
</section>
|
||||
<section class="hub-block" aria-labelledby="h-rules">
|
||||
<h2 class="title" id="h-rules">The rules</h2>
|
||||
<ol class="hub-rules">
|
||||
<li><strong>Vanilla is the specification.</strong> Wherever Minecraft 26.3 has the feature, Horizon does exactly what it does: read vanilla's code, then match it.</li>
|
||||
<li><strong>Small pull requests, proven.</strong> One change each, under about 500 lines, with the block <code>python3 tools/pr_ready.py</code> prints: formatting, Clippy, tests and the harnesses your change can affect.</li>
|
||||
<li><strong>Say who wrote it.</strong> If an AI agent wrote or posts it, the pull request says so, and commits keep its co-author line.</li>
|
||||
<li><strong>Never commit Mojang's files.</strong> No game jars, assets, decompiled code or prepared resources, and nothing taken from other mods' code.</li>
|
||||
</ol>
|
||||
<p class="hub-actions"><a class="button primary" href="/docs/contributing">The contributing guide</a><a class="button secondary" href="https://github.com/ludovic111/horizon/blob/main/CONTRIBUTING.md">CONTRIBUTING.md</a></p>
|
||||
</section>
|
||||
<section class="hub-block" id="contributors" aria-labelledby="h-contributors">
|
||||
<h2 class="title" id="h-contributors">Contributors</h2>
|
||||
<p class="hub-intro">Everyone with commits in Horizon. On Discord, <code>/link-github <your login> credit:True</code> adds your Discord name next to yours.</p>
|
||||
<ul class="contributors-list hub-people">{{HUB_CREDIT}}</ul>
|
||||
<p class="meta"><a href="https://github.com/ludovic111/horizon/graphs/contributors">All contributors on GitHub</a></p>
|
||||
</section>
|
||||
</div>
|
||||
<p class="disclaimer">Not an official Minecraft product. Not approved by or associated with Mojang or Microsoft.</p>
|
||||
</div>
|
||||
</main>
|
||||
{{SITE_FOOTER}}
|
||||
<script type="application/json" id="hub-data">{{HUB_DATA}}</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,457 @@
|
||||
// The hub (/hub): the roadmap from website/data/roadmap.json (generated from roadmap/roadmap.toml by
|
||||
// tools/roadmap.py), with each item's issues and pull requests in their live GitHub state. Shared by build.mjs
|
||||
// (baked into the page) and hub-page.js (refreshed from GitHub in the browser). Every item says the same thing
|
||||
// twice: `plain` (.hub-plain) for players and `dev` (.hub-dev) for contributors; the page's Simple / Technical
|
||||
// switch shows one of them.
|
||||
import { escape, inline } from "./markdown.js";
|
||||
import { parts, plainItem, sections } from "./releases.js";
|
||||
import { isGame, isLauncher } from "./versions.js";
|
||||
import { avatar } from "./contributors.js";
|
||||
|
||||
export const REPO = "ludovic111/horizon";
|
||||
const issueUrl = (n) => `https://github.com/${REPO}/issues/${n}`;
|
||||
const fileUrl = (path) => `https://github.com/${REPO}/blob/main/${path}`;
|
||||
|
||||
// The issues a pull request closes when merged: "Fixes #12", "closes #3, resolves #4" (as Kira's board reads them).
|
||||
export function fixesIn(text) {
|
||||
const out = new Set();
|
||||
for (const m of String(text ?? "").matchAll(/\b(?:fix(?:e[sd])?|close[sd]?|resolve[sd]?)\s*:?\s+((?:#\d+(?:\s*(?:,|and)\s*)?)+)/gi)) {
|
||||
for (const n of m[1].matchAll(/#(\d+)/g)) out.add(Number(n[1]));
|
||||
}
|
||||
return [...out].sort((a, b) => a - b);
|
||||
}
|
||||
|
||||
// A GitHub issue or pull request (from /issues, which lists both) reduced to what the hub shows.
|
||||
export function slimIssue(raw) {
|
||||
const pr = Boolean(raw.pull_request);
|
||||
const merged = pr && raw.pull_request.merged_at;
|
||||
return {
|
||||
n: raw.number,
|
||||
title: String(raw.title || ""),
|
||||
kind: pr ? "pr" : "issue",
|
||||
state: merged ? "merged" : raw.state === "open" ? "open" : raw.state_reason === "not_planned" ? "dropped" : "closed",
|
||||
draft: Boolean(raw.draft),
|
||||
user: raw.user?.login || "",
|
||||
labels: (raw.labels || []).map((l) => (typeof l === "string" ? l : l.name)).filter(Boolean),
|
||||
assigned: (raw.assignees || []).length > 0,
|
||||
fixes: pr ? fixesIn(raw.body) : [],
|
||||
at: merged || raw.closed_at || raw.updated_at || "",
|
||||
url: raw.html_url || issueUrl(raw.number),
|
||||
};
|
||||
}
|
||||
|
||||
const number = (link) => Number((String(link).match(/^#(\d+)$/) || [])[1]) || null;
|
||||
|
||||
// "#12 in review", "#13 merged": a link's state, when GitHub told us.
|
||||
function linkState(issue) {
|
||||
if (!issue) return null;
|
||||
if (issue.kind === "pr") return issue.state === "open" ? (issue.draft ? "in progress" : "in review") : issue.state;
|
||||
return issue.state === "open" ? "open" : "closed";
|
||||
}
|
||||
|
||||
function linkHtml(link, live) {
|
||||
const n = number(link);
|
||||
if (!n) {
|
||||
const url = link.startsWith("https://") ? link : fileUrl(link);
|
||||
return `<a class="hub-link" href="${escape(url)}">${escape(link.replace(/^https:\/\//, ""))}</a>`;
|
||||
}
|
||||
const issue = live.get(n);
|
||||
const state = linkState(issue);
|
||||
const label = issue ? `${issue.kind === "pr" ? "Pull request" : "Issue"} #${n}: ${issue.title}` : `#${n}`;
|
||||
return `<a class="hub-link${state ? ` is-${state.replace(" ", "-")}` : ""}" href="${issueUrl(n)}" title="${escape(label)}">#${n}${state ? ` <span>${state}</span>` : ""}</a>`;
|
||||
}
|
||||
|
||||
// The technical text with its #N and the item's own paths as links.
|
||||
function devHtml(item) {
|
||||
let text = item.dev.replace(/(^|[^\w[/`])#(\d+)\b/g, (_, before, n) => `${before}[#${n}](${issueUrl(n)})`);
|
||||
for (const link of item.links || []) {
|
||||
if (!number(link) && !link.startsWith("https://")) text = text.replace(link, `[${link}](${fileUrl(link)})`);
|
||||
}
|
||||
return inline(text);
|
||||
}
|
||||
|
||||
// "2 pull requests in review · 3 merged · 1 issue open", from the item's links.
|
||||
export function progress(item, live) {
|
||||
const known = (item.links || []).map(number).filter(Boolean).map((n) => live.get(n)).filter(Boolean);
|
||||
const pulls = known.filter((i) => i.kind === "pr");
|
||||
const count = (list, word) => (list.length ? `${list.length} ${word}` : "");
|
||||
const parts = [
|
||||
count(pulls.filter((p) => p.state === "open" && !p.draft), pulls.filter((p) => p.state === "open" && !p.draft).length === 1 ? "pull request in review" : "pull requests in review"),
|
||||
count(pulls.filter((p) => p.state === "open" && p.draft), "in progress"),
|
||||
count(pulls.filter((p) => p.state === "merged"), "merged"),
|
||||
count(known.filter((i) => i.kind === "issue" && i.state === "open"), known.filter((i) => i.kind === "issue" && i.state === "open").length === 1 ? "issue open" : "issues open"),
|
||||
].filter(Boolean);
|
||||
return parts.join(" · ");
|
||||
}
|
||||
|
||||
const areaName = (roadmap, id) => roadmap.areas.find((a) => a.id === id)?.name || id;
|
||||
|
||||
// An item's vote button: hidden until the page has the counts from the hub's server (hub-page.js).
|
||||
export function voteHtml(item) {
|
||||
return `<button type="button" class="button secondary small hub-vote" data-vote="${escape(item.id)}" aria-pressed="false" hidden><span class="hub-vote-label">Want it</span><span class="hub-vote-count" data-votes></span></button>`;
|
||||
}
|
||||
|
||||
export function itemHtml(item, roadmap, live) {
|
||||
const done = item.status === "shipped";
|
||||
const state = done ? "" : progress(item, live);
|
||||
return `<article class="hub-item" id="${escape(item.id)}" data-area="${escape(item.area)}" data-item="${escape(item.id)}">
|
||||
<p class="hub-item-meta"><span class="badge">${escape(areaName(roadmap, item.area))}</span>${done ? `<span class="badge badge-game">${escape(item.shipped_in)}</span>` : ""}${item.ongoing ? `<span class="hub-ongoing">Ongoing</span>` : ""}${done ? "" : voteHtml(item)}</p>
|
||||
<h3 class="hub-item-title">${escape(item.title)}</h3>
|
||||
<p class="hub-plain">${inline(item.plain)}</p>
|
||||
<p class="hub-dev">${devHtml(item)}</p>
|
||||
${state ? `<p class="hub-progress" data-progress>${escape(state)}</p>` : ""}
|
||||
<p class="hub-links">${(item.links || []).map((l) => linkHtml(l, live)).join("")}</p>
|
||||
</article>`;
|
||||
}
|
||||
|
||||
const SECTION_LEDE = {
|
||||
now: "Being worked on, with pull requests open or just merged.",
|
||||
next: "Decided, and up after what is being done now.",
|
||||
later: "Decided, further out.",
|
||||
"help-wanted": "Good first contributions: a clear vanilla behaviour, an issue with the steps, a place to start.",
|
||||
shipped: "Out in a release. The journal has every change.",
|
||||
};
|
||||
|
||||
// The Roadmap tab: one section per status, the items in the file's order (areas by priority).
|
||||
export function roadmapHtml(roadmap, live = new Map()) {
|
||||
const order = new Map(roadmap.areas.map((a, i) => [a.id, i]));
|
||||
return roadmap.statuses
|
||||
.map(({ id, name }) => {
|
||||
const items = roadmap.items.filter((i) => i.status === id);
|
||||
if (!items.length) return "";
|
||||
// Shipped stays newest first; the others go by the areas' priority.
|
||||
if (id !== "shipped") items.sort((a, b) => order.get(a.area) - order.get(b.area));
|
||||
return `<section class="hub-section" id="${id}" data-status="${id}" aria-labelledby="h-${id}">
|
||||
<div class="hub-section-head"><h2 class="title" id="h-${id}">${escape(name)}</h2><p class="meta">${escape(SECTION_LEDE[id] || "")}</p></div>
|
||||
<div class="hub-items">
|
||||
${items.map((item) => itemHtml(item, roadmap, live)).join("\n")}
|
||||
</div>
|
||||
</section>`;
|
||||
})
|
||||
.join("\n");
|
||||
}
|
||||
|
||||
// The area filter's buttons: every area that has an item.
|
||||
export function areaFilterHtml(roadmap) {
|
||||
const used = roadmap.areas.filter((a) => roadmap.items.some((i) => i.area === a.id));
|
||||
return [`<button type="button" class="button secondary small" data-area-filter="all" aria-pressed="true">All</button>`]
|
||||
.concat(used.map((a) => `<button type="button" class="button secondary small" data-area-filter="${escape(a.id)}" aria-pressed="false">${escape(a.name)}</button>`))
|
||||
.join("\n");
|
||||
}
|
||||
|
||||
// The Overview tab: where Horizon is, the 3 to 5 things in focus, what is next, what shipped last, how to help.
|
||||
export function overviewHtml(roadmap, live = new Map()) {
|
||||
const o = roadmap.overview;
|
||||
const focus = roadmap.items.filter((i) => i.focus);
|
||||
const next = roadmap.items.filter((i) => i.status === "next");
|
||||
const shipped = roadmap.items.filter((i) => i.status === "shipped").slice(0, 3);
|
||||
const row = (item, i, meta) => `<li class="row"><a href="#${escape(item.id)}" data-goto="roadmap"><span class="row-index">${String(i + 1).padStart(2, "0")}</span><span class="hub-row-body"><span class="hub-row-title">${escape(item.title)}</span><span class="hub-plain">${inline(item.plain)}</span><span class="hub-dev">${inline(item.dev)}</span></span><span class="row-meta">${escape(meta(item))}</span></a></li>`;
|
||||
return `<div class="hub-today">
|
||||
<p class="hub-plain hub-lead">${inline(o.today_plain)}</p>
|
||||
<p class="hub-dev hub-lead">${inline(o.today_dev)}</p>
|
||||
</div>
|
||||
<section class="hub-block" aria-labelledby="h-ov-focus">
|
||||
<h2 class="title" id="h-ov-focus">Being done now</h2>
|
||||
<ol class="index hub-rows">${focus.map((item, i) => row(item, i, (x) => progress(x, live))).join("")}</ol>
|
||||
</section>
|
||||
<section class="hub-block" aria-labelledby="h-ov-next">
|
||||
<h2 class="title" id="h-ov-next">Next</h2>
|
||||
<ol class="index hub-rows">${next.map((item, i) => row(item, i, (x) => areaName(roadmap, x.area))).join("")}</ol>
|
||||
</section>
|
||||
<section class="hub-block" aria-labelledby="h-ov-shipped">
|
||||
<h2 class="title" id="h-ov-shipped">Recently shipped</h2>
|
||||
<ol class="index hub-rows">${shipped.map((item, i) => row(item, i, (x) => `In ${x.shipped_in}`)).join("")}</ol>
|
||||
</section>
|
||||
<section class="hub-block hub-help" aria-labelledby="h-ov-help">
|
||||
<h2 class="title" id="h-ov-help">How to help</h2>
|
||||
<p class="hub-plain">${inline(o.help_plain)}</p>
|
||||
<p class="hub-dev">${inline(o.help_dev)}</p>
|
||||
<p class="hub-actions"><a class="button primary" href="#contribute" data-goto="contribute">Contribute</a><a class="button secondary" href="#help-wanted" data-goto="roadmap">Help wanted</a><a class="button secondary" href="#report">Report a bug</a><a class="button secondary" href="#suggest">Suggest something</a></p>
|
||||
</section>`;
|
||||
}
|
||||
|
||||
// The Contribute tab's list of good first tasks.
|
||||
export function helpWantedHtml(roadmap) {
|
||||
return roadmap.items
|
||||
.filter((i) => i.status === "help-wanted")
|
||||
.map((item, i) => {
|
||||
const first = (item.links || []).map(number).find(Boolean);
|
||||
const href = first ? issueUrl(first) : `#${item.id}`;
|
||||
return `<li class="row"><a href="${escape(href)}"><span class="row-index">${String(i + 1).padStart(2, "0")}</span><span class="hub-row-body"><span class="hub-row-title">${escape(item.title)}</span><span class="hub-plain">${inline(item.plain)}</span><span class="hub-dev">${inline(item.dev)}</span></span><span class="row-meta">${first ? `#${first}` : ""}</span></a></li>`;
|
||||
})
|
||||
.join("");
|
||||
}
|
||||
|
||||
// --- The work board --------------------------------------------------------------------------------------------
|
||||
|
||||
export const COLUMNS = [
|
||||
{ id: "todo", name: "To do", about: "Open and free: pick one, and say so with /claim on Discord." },
|
||||
{ id: "progress", name: "In progress", about: "Claimed, assigned, or a draft pull request." },
|
||||
{ id: "review", name: "In review", about: "A pull request is ready for review." },
|
||||
{ id: "done", name: "Done", about: "Closed or merged in the last seven days." },
|
||||
];
|
||||
const DONE_DAYS = 7;
|
||||
|
||||
// The roadmap item an issue or pull request moves: its roadmap:<id> label, else the item linking it, else (for a
|
||||
// pull request) the item linking an issue it fixes.
|
||||
export function itemOf(issue, roadmap) {
|
||||
const label = issue.labels.find((l) => l.startsWith("roadmap:"));
|
||||
const ids = new Set(roadmap.items.map((i) => i.id));
|
||||
if (label && ids.has(label.slice(8))) return label.slice(8);
|
||||
const linking = (n) => roadmap.items.find((i) => (i.links || []).includes(`#${n}`))?.id;
|
||||
return linking(issue.n) || issue.fixes.map(linking).find(Boolean) || null;
|
||||
}
|
||||
|
||||
// The board from GitHub's open issues and pull requests and those closed lately, placed as Kira's work board places
|
||||
// them: an issue goes to review when an open, ready pull request fixes it, to progress when a draft one does or it is
|
||||
// claimed or assigned; a pull request that fixes no open issue is a card of its own.
|
||||
export function boardFrom(list, roadmap, now = Date.now()) {
|
||||
const columns = Object.fromEntries(COLUMNS.map((c) => [c.id, []]));
|
||||
const open = list.filter((i) => i.state === "open");
|
||||
const openIssues = new Set(open.filter((i) => i.kind === "issue").map((i) => i.n));
|
||||
const fixing = (n) => open.filter((p) => p.kind === "pr" && p.fixes.includes(n));
|
||||
const card = (i, prs = []) => ({ n: i.n, kind: i.kind, title: i.title, user: i.user, url: i.url, item: itemOf(i, roadmap) || prs.map((p) => itemOf(p, roadmap)).find(Boolean) || null, prs: prs.map((p) => p.n) });
|
||||
for (const i of open) {
|
||||
if (i.kind === "issue") {
|
||||
const prs = fixing(i.n);
|
||||
const claimed = i.assigned || i.labels.some((l) => /^(in progress|claimed)$/i.test(l));
|
||||
const column = prs.some((p) => !p.draft) ? "review" : prs.length || claimed ? "progress" : "todo";
|
||||
columns[column].push(card(i, prs));
|
||||
} else if (!i.fixes.some((n) => openIssues.has(n))) {
|
||||
columns[i.draft ? "progress" : "review"].push(card(i));
|
||||
}
|
||||
}
|
||||
const since = now - DONE_DAYS * 864e5;
|
||||
const seen = new Set();
|
||||
for (const i of list) {
|
||||
if (seen.has(i.n) || !["merged", "closed"].includes(i.state) || !(Date.parse(i.at) >= since)) continue;
|
||||
seen.add(i.n);
|
||||
columns.done.push(card(i));
|
||||
}
|
||||
columns.done.sort((a, b) => b.n - a.n);
|
||||
return columns;
|
||||
}
|
||||
|
||||
const SHOWN = 20; // cards per column before "Show more"
|
||||
|
||||
function cardHtml(c, roadmap, more) {
|
||||
const item = c.item && roadmap.items.find((i) => i.id === c.item);
|
||||
return `<li class="hub-card" data-item="${escape(c.item || "")}"${more ? " data-more" : ""}><a href="${escape(c.url)}"><span class="hub-card-ref">${c.kind === "pr" ? "PR" : "Issue"} #${c.n}${c.prs.length ? ` · ${c.prs.map((n) => `PR #${n}`).join(", ")}` : ""}</span><span class="hub-card-title">${escape(c.title)}</span><span class="hub-card-meta">${item ? `<span class="hub-card-item">${escape(item.title)}</span>` : ""}${c.user ? `<span>${escape(c.user)}</span>` : ""}</span></a></li>`;
|
||||
}
|
||||
|
||||
export function boardHtml(columns, roadmap) {
|
||||
return COLUMNS.map(({ id, name, about }) => {
|
||||
const cards = columns[id];
|
||||
return `<section class="hub-column" data-column="${id}" aria-labelledby="col-${id}">
|
||||
<h3 id="col-${id}"><span>${escape(name)}</span><span class="hub-count" data-count>${cards.length}</span></h3>
|
||||
<p class="meta">${escape(about)}</p>
|
||||
<ol class="hub-cards-list">${cards.map((c, i) => cardHtml(c, roadmap, i >= SHOWN)).join("")}</ol>
|
||||
${cards.length > SHOWN ? `<button type="button" class="button secondary small hub-more" data-more-button>Show ${cards.length - SHOWN} more</button>` : ""}
|
||||
</section>`;
|
||||
}).join("\n");
|
||||
}
|
||||
|
||||
// The board's roadmap filter: every item that has a card.
|
||||
export function boardFilterHtml(columns, roadmap) {
|
||||
const used = new Set(Object.values(columns).flat().map((c) => c.item).filter(Boolean));
|
||||
return [`<option value="">Every card</option>`, `<option value="-">Cards of a roadmap item</option>`]
|
||||
.concat(roadmap.items.filter((i) => used.has(i.id)).map((i) => `<option value="${escape(i.id)}">${escape(i.title)}</option>`))
|
||||
.join("");
|
||||
}
|
||||
|
||||
// --- The journal -----------------------------------------------------------------------------------------------
|
||||
|
||||
export const JOURNAL_URL = "https://playhorizon.dev/hub#journal";
|
||||
const ENTRIES = 40;
|
||||
|
||||
// The journal, newest first: each release with its changes grouped by roadmap item, the weekly summaries
|
||||
// (roadmap/journal/), and what merged since the newest game release. releases: GitHub's release objects; list: the
|
||||
// hub's issues and pull requests (their roadmap:<id> labels place changes the roadmap doesn't link).
|
||||
export function journalFrom(releases, list, roadmap) {
|
||||
const prs = new Map(list.filter((i) => i.kind === "pr").map((i) => [i.n, i]));
|
||||
const placed = (numbers) => {
|
||||
for (const n of numbers) {
|
||||
const known = prs.get(n);
|
||||
const id = known ? itemOf(known, roadmap) : roadmap.items.find((i) => (i.links || []).includes(`#${n}`))?.id;
|
||||
if (id) return id;
|
||||
}
|
||||
return null;
|
||||
};
|
||||
const ours = releases.filter((r) => !r.draft && (isGame(r.tag_name) || isLauncher(r.tag_name)));
|
||||
const entries = ours.map((r) => {
|
||||
const changes = sections(r.body)
|
||||
.filter((x) => /^(new|what's new|fixed)/i.test(x.title))
|
||||
.flatMap((x) => x.items.map((text) => ({ section: /^fixed/i.test(x.title) ? "fixed" : "new", text })))
|
||||
.map((c) => {
|
||||
const numbers = [...c.text.matchAll(/#(\d+)/g)].map((m) => Number(m[1]));
|
||||
return { ...c, text: plainItem(c.text), prs: numbers, item: placed(numbers) };
|
||||
});
|
||||
return {
|
||||
id: r.tag_name,
|
||||
kind: isLauncher(r.tag_name) ? "launcher" : "release",
|
||||
date: r.published_at || "",
|
||||
title: r.name || r.tag_name,
|
||||
plain: parts(r).line,
|
||||
url: r.html_url,
|
||||
changes,
|
||||
shipped: roadmap.items.filter((i) => i.status === "shipped" && i.shipped_in === r.tag_name).map((i) => i.id),
|
||||
};
|
||||
});
|
||||
// Merged but in no release's notes yet: a release is cut from main a while after its last merge, so the newest
|
||||
// releases' notes, not their dates, say what they hold. Pull requests players don't see (skip-release) never are.
|
||||
const games = ours.filter((r) => isGame(r.tag_name)).map((r) => r.published_at).sort().reverse();
|
||||
const since = games[Math.min(4, games.length - 1)] || "";
|
||||
const noted = new Set(entries.flatMap((e) => e.changes.flatMap((c) => c.prs)));
|
||||
const pending = list
|
||||
.filter((i) => i.kind === "pr" && i.state === "merged" && i.at > since && !noted.has(i.n) && !i.labels.includes("skip-release"))
|
||||
.sort((a, b) => b.at.localeCompare(a.at));
|
||||
if (pending.length) {
|
||||
entries.push({
|
||||
id: "next-release",
|
||||
kind: "merged",
|
||||
date: pending[0].at,
|
||||
title: "Merged, in the next release",
|
||||
plain: `${pending.length} change${pending.length === 1 ? "" : "s"} merged since the last release.`,
|
||||
url: `https://github.com/${REPO}/pulls?q=is%3Apr+is%3Amerged`,
|
||||
changes: pending.map((p) => ({ section: "merged", text: p.title, prs: [p.n], item: itemOf(p, roadmap) })),
|
||||
shipped: [],
|
||||
});
|
||||
}
|
||||
for (const w of roadmap.journal || []) {
|
||||
// A week's summary sits after its last day's releases.
|
||||
const end = new Date(Date.parse(w.date) + 7 * 864e5 - 1).toISOString();
|
||||
entries.push({ id: `week-${w.week}`, kind: "week", date: end, title: w.title, plain: w.plain, dev: w.dev, url: `${JOURNAL_URL.replace("#journal", "")}#week-${w.week}`, changes: [], shipped: [] });
|
||||
}
|
||||
return entries.sort((a, b) => b.date.localeCompare(a.date)).slice(0, ENTRIES);
|
||||
}
|
||||
|
||||
const HUB = "https://playhorizon.dev/hub";
|
||||
const FEED = 300;
|
||||
|
||||
// /data/journal.json, which Kira reads for #updates and X (kira's src/journal.js): one flat entry per merged pull
|
||||
// request, release, shipped roadmap item and weekly summary, newest first. An entry's id never changes: Kira posts
|
||||
// each id once. Shipped items carry `post` (at most 240 characters, tools/roadmap.py checks) and `announce`.
|
||||
export function journalJson(releases, list, roadmap, generated = new Date().toISOString()) {
|
||||
const items = new Map(roadmap.items.map((i) => [i.id, i]));
|
||||
const ours = releases.filter((r) => !r.draft && (isGame(r.tag_name) || isLauncher(r.tag_name)));
|
||||
const published = new Map(ours.map((r) => [r.tag_name, r.published_at || ""]));
|
||||
const merges = list
|
||||
.filter((i) => i.kind === "pr" && i.state === "merged")
|
||||
.map((pr) => ({ pr, item: itemOf(pr, roadmap) }))
|
||||
// What players see, and anything that moves a roadmap item.
|
||||
.filter(({ pr, item }) => item || !pr.labels.includes("skip-release"))
|
||||
.map(({ pr, item }) => ({
|
||||
id: `pr-${pr.n}`,
|
||||
kind: "merge",
|
||||
date: pr.at,
|
||||
title: pr.title,
|
||||
url: pr.url,
|
||||
number: pr.n,
|
||||
...(item ? { item, item_title: items.get(item)?.title } : {}),
|
||||
}));
|
||||
const released = ours.map((r) => ({
|
||||
id: `release-${r.tag_name}`,
|
||||
kind: "release",
|
||||
date: r.published_at || "",
|
||||
title: r.name || r.tag_name,
|
||||
plain: parts(r).line,
|
||||
url: r.html_url,
|
||||
tag: r.tag_name,
|
||||
}));
|
||||
const shipped = roadmap.items
|
||||
.filter((i) => i.status === "shipped")
|
||||
.map((i) => ({
|
||||
id: `shipped-${i.id}`,
|
||||
kind: "shipped",
|
||||
date: published.get(i.shipped_in) || generated,
|
||||
title: i.title,
|
||||
plain: i.plain,
|
||||
url: `${HUB}#${i.id}`,
|
||||
item: i.id,
|
||||
item_title: i.title,
|
||||
shipped_in: i.shipped_in,
|
||||
post: i.post || i.plain,
|
||||
announce: Boolean(i.announce),
|
||||
}));
|
||||
// A week's summary is dated at the end of its week, after that week's releases.
|
||||
const weekly = (roadmap.journal || []).map((w) => ({
|
||||
id: `weekly-${w.week}`,
|
||||
kind: "weekly",
|
||||
date: new Date(Date.parse(w.date) + 7 * 864e5 - 1000).toISOString(),
|
||||
title: w.title,
|
||||
plain: w.plain,
|
||||
dev: w.dev,
|
||||
url: `${HUB}#week-${w.week}`,
|
||||
}));
|
||||
const entries = [...merges, ...released, ...shipped, ...weekly].sort((a, b) => b.date.localeCompare(a.date) || a.id.localeCompare(b.id));
|
||||
return { format: "horizon-journal", version: 2, generated, url: `${HUB}#journal`, entries: entries.slice(0, FEED) };
|
||||
}
|
||||
|
||||
const KIND = { release: "Game", launcher: "Launcher", merged: "Merged", week: "This week" };
|
||||
|
||||
function changesHtml(entry, roadmap) {
|
||||
if (!entry.changes.length) return "";
|
||||
const line = (c) => `<li>${inline(c.text)}${c.prs.length ? ` ${c.prs.map((n) => `<a class="hub-ref" href="${issueUrl(n)}">#${n}</a>`).join(" ")}` : ""}</li>`;
|
||||
// Simple: what is new, then how many fixes. Technical: every change, under the roadmap item it moves.
|
||||
const added = entry.changes.filter((c) => c.section !== "fixed");
|
||||
const fixes = entry.changes.length - added.length;
|
||||
const simple = `<div class="hub-plain">${added.length ? `<ul class="hub-changes">${added.map((c) => `<li>${inline(c.text)}</li>`).join("")}</ul>` : ""}${fixes ? `<p class="meta">${added.length ? "And " : ""}${fixes} fix${fixes === 1 ? "" : "es"}.</p>` : ""}</div>`;
|
||||
const groups = new Map();
|
||||
for (const c of entry.changes) groups.set(c.item || "", [...(groups.get(c.item || "") || []), c]);
|
||||
const order = [...groups.keys()].sort((a, b) => (a === "") - (b === ""));
|
||||
const dev = `<div class="hub-dev">${order
|
||||
.map((id) => {
|
||||
const item = roadmap.items.find((i) => i.id === id);
|
||||
return `<p class="hub-group">${item ? `<a href="#${escape(id)}">${escape(item.title)}</a>` : "Other changes"}</p><ul class="hub-changes">${groups.get(id).map(line).join("")}</ul>`;
|
||||
})
|
||||
.join("")}</div>`;
|
||||
return simple + dev;
|
||||
}
|
||||
|
||||
export function journalHtml(entries, roadmap) {
|
||||
return entries
|
||||
.map((e) => {
|
||||
const shipped = e.shipped.map((id) => roadmap.items.find((i) => i.id === id)).filter(Boolean);
|
||||
const items = [...new Set(e.changes.map((c) => c.item).filter(Boolean))].map((id) => roadmap.items.find((i) => i.id === id)).filter(Boolean);
|
||||
return `<article class="hub-entry hub-entry-${e.kind}" id="${e.kind === "week" ? escape(e.id) : `journal-${escape(e.id.replace(/[^\w.-]/g, "-"))}`}">
|
||||
<p class="hub-entry-meta"><span class="badge${e.kind === "release" ? " badge-game" : e.kind === "launcher" ? " badge-launcher" : ""}">${KIND[e.kind]}</span><time datetime="${escape(e.date)}">${escape(e.date.slice(0, 10))}</time></p>
|
||||
<h3 class="hub-entry-title">${e.url ? `<a href="${escape(e.url)}">${escape(e.title)}</a>` : escape(e.title)}</h3>
|
||||
${e.kind === "week" ? `<p class="hub-plain">${inline(e.plain)}</p><p class="hub-dev">${inline(e.dev.replace(/(^|[^\w[/`])#(\d+)\b/g, (_, b, n) => `${b}[#${n}](${issueUrl(n)})`))}</p>` : ""}
|
||||
${shipped.length ? `<p class="hub-shipped">Shipped: ${shipped.map((i) => `<a href="#${escape(i.id)}">${escape(i.title)}</a>`).join(", ")}</p>` : ""}
|
||||
${items.length ? `<p class="hub-entry-items hub-plain">${items.map((i) => `<a class="hub-link" href="#${escape(i.id)}">${escape(i.title)}</a>`).join("")}</p>` : ""}
|
||||
${changesHtml(e, roadmap)}
|
||||
</article>`;
|
||||
})
|
||||
.join("\n");
|
||||
}
|
||||
|
||||
// --- Contribute: the suggestion form's items and the contributors ------------------------------------------------
|
||||
|
||||
// The suggestion form's "About" choices: the items still to come.
|
||||
export function suggestItemsHtml(roadmap) {
|
||||
const open = roadmap.items.filter((i) => i.status !== "shipped");
|
||||
return [`<option value="">Something new</option>`]
|
||||
.concat(open.map((i) => `<option value="${escape(i.id)}">${escape(i.title)}</option>`))
|
||||
.join("");
|
||||
}
|
||||
|
||||
// The contributors, from GitHub (contributors.js's list), with the Discord name of those who linked their accounts
|
||||
// on Kira and agreed to be credited (Kira's /contributors.json: { contributors: [{ github, discord }] }).
|
||||
export function creditFrom(github, kira) {
|
||||
const discord = new Map(
|
||||
(Array.isArray(kira?.contributors) ? kira.contributors : [])
|
||||
.filter((c) => c && typeof c.github === "string" && typeof c.discord === "string")
|
||||
.map((c) => [c.github.toLowerCase(), c.discord]),
|
||||
);
|
||||
return github.map((c) => ({ ...c, discord: discord.get(c.login.toLowerCase()) || "" }));
|
||||
}
|
||||
|
||||
export function creditHtml(list) {
|
||||
return list
|
||||
.map((c) => {
|
||||
const src = avatar(c.avatar_url);
|
||||
const count = `${c.contributions.toLocaleString("en-US")} ${c.contributions === 1 ? "commit" : "commits"}`;
|
||||
return `<li><a class="contributor" href="${escape(c.html_url)}">${src ? `<img class="contributor-avatar" loading="lazy" decoding="async" src="${escape(src)}" width="48" height="48" alt="">` : `<span class="contributor-avatar" aria-hidden="true"></span>`}<span class="contributor-name">${escape(c.login)}</span><span class="contributor-count">${count}${c.discord ? ` · ${escape(c.discord)} on Discord` : ""}</span></a></li>`;
|
||||
})
|
||||
.join("");
|
||||
}
|
||||
@@ -0,0 +1,159 @@
|
||||
import { test } from "node:test";
|
||||
import assert from "node:assert/strict";
|
||||
import { readFileSync } from "node:fs";
|
||||
import { boardFrom, boardHtml, creditFrom, creditHtml, fixesIn, itemOf, journalFrom, journalHtml, journalJson, overviewHtml, progress, roadmapHtml, slimIssue, suggestItemsHtml } from "./hub.js";
|
||||
|
||||
const roadmap = JSON.parse(readFileSync(new URL("../data/roadmap.json", import.meta.url), "utf8"));
|
||||
|
||||
const pr = (number, extra = {}) => ({ number, title: `PR ${number}`, state: "open", pull_request: { merged_at: null }, user: { login: "a" }, labels: [], assignees: [], body: "", ...extra });
|
||||
const issue = (number, extra = {}) => ({ number, title: `Issue ${number}`, state: "open", user: { login: "b" }, labels: [{ name: "bug" }], assignees: [], ...extra });
|
||||
|
||||
test("pull requests and issues reduce to their hub state", () => {
|
||||
assert.deepEqual(fixesIn("Fixes #12, #13 and closes #4. Mentions #9."), [4, 12, 13]);
|
||||
const merged = slimIssue(pr(5, { state: "closed", pull_request: { merged_at: "2030-01-01T00:00:00Z" }, body: "Fixes #3" }));
|
||||
assert.equal(merged.kind, "pr");
|
||||
assert.equal(merged.state, "merged");
|
||||
assert.deepEqual(merged.fixes, [3]);
|
||||
assert.equal(slimIssue(issue(6, { state: "closed", state_reason: "not_planned" })).state, "dropped");
|
||||
assert.deepEqual(slimIssue(issue(7)).labels, ["bug"]);
|
||||
});
|
||||
|
||||
test("an item's progress counts its pull requests and issues", () => {
|
||||
const live = new Map([
|
||||
[1, slimIssue(pr(1))],
|
||||
[2, slimIssue(pr(2, { draft: true }))],
|
||||
[3, slimIssue(pr(3, { state: "closed", pull_request: { merged_at: "2030-01-01T00:00:00Z" } }))],
|
||||
[4, slimIssue(issue(4))],
|
||||
]);
|
||||
const item = { links: ["#1", "#2", "#3", "#4", "#99", "docs/x.md"] };
|
||||
assert.equal(progress(item, live), "1 pull request in review · 1 in progress · 1 merged · 1 issue open");
|
||||
assert.equal(progress(item, new Map()), "");
|
||||
});
|
||||
|
||||
test("the roadmap renders every item once, with both texts, in its status's section", () => {
|
||||
const html = roadmapHtml(roadmap);
|
||||
for (const item of roadmap.items) {
|
||||
assert.equal(html.split(`id="${item.id}"`).length, 2, item.id);
|
||||
}
|
||||
assert.ok(html.indexOf('id="now"') < html.indexOf('id="next"'));
|
||||
assert.ok(html.includes('class="hub-plain"') && html.includes('class="hub-dev"'));
|
||||
// Shipped items say which release had them.
|
||||
assert.ok(html.includes(`>${roadmap.items.find((i) => i.status === "shipped").shipped_in}<`));
|
||||
});
|
||||
|
||||
test("an item is its own anchor (hub#<id>, as Kira links it) and takes no other id of the page", () => {
|
||||
const week = { week: "2030-01", date: "2029-12-31", title: "A week", plain: "p", dev: "d" };
|
||||
const release = { tag_name: "v0.2.2", name: "0.2.2", published_at: "2030-01-02T00:00:00Z", html_url: "u", body: "" };
|
||||
const journal = journalHtml(journalFrom([release], [], { ...roadmap, journal: [week] }), roadmap);
|
||||
const board = boardHtml(boardFrom([], roadmap), roadmap);
|
||||
const page = readFileSync(new URL("./hub.html", import.meta.url), "utf8") + roadmapHtml(roadmap) + overviewHtml(roadmap) + board + journal;
|
||||
const ids = [...page.matchAll(/ id="([^"]+)"/g)].map((m) => m[1]);
|
||||
assert.deepEqual(ids.filter((id, i) => ids.indexOf(id) !== i), []);
|
||||
for (const item of roadmap.items) assert.ok(ids.includes(item.id), item.id);
|
||||
});
|
||||
|
||||
test("the overview lists the focus items and never nests links", () => {
|
||||
const html = overviewHtml(roadmap);
|
||||
for (const item of roadmap.items.filter((i) => i.focus)) assert.ok(html.includes(`href="#${item.id}"`), item.id);
|
||||
for (const row of html.match(/<li class="row">[\s\S]*?<\/li>/g)) assert.equal(row.split("<a ").length, 2, row);
|
||||
});
|
||||
|
||||
test("the board places issues and pull requests as Kira's board does", () => {
|
||||
const now = Date.parse("2030-01-10T00:00:00Z");
|
||||
const list = [
|
||||
issue(1),
|
||||
issue(2),
|
||||
issue(3, { assignees: [{ login: "x" }] }),
|
||||
pr(10, { body: "Fixes #1" }),
|
||||
pr(11, { body: "Fixes #2", draft: true }),
|
||||
pr(12, { labels: [{ name: `roadmap:${roadmap.items[0].id}` }] }),
|
||||
pr(13, { draft: true }),
|
||||
pr(14, { state: "closed", pull_request: { merged_at: "2030-01-09T00:00:00Z" } }),
|
||||
pr(15, { state: "closed", pull_request: { merged_at: "2029-12-01T00:00:00Z" } }),
|
||||
].map(slimIssue);
|
||||
const board = boardFrom(list, roadmap, now);
|
||||
const ids = (column) => board[column].map((c) => c.n);
|
||||
assert.deepEqual(ids("todo"), []);
|
||||
assert.deepEqual(ids("progress"), [2, 3, 13]);
|
||||
assert.deepEqual(ids("review"), [1, 12]);
|
||||
assert.deepEqual(ids("done"), [14]);
|
||||
assert.deepEqual(board.review[0].prs, [10]);
|
||||
assert.equal(board.review[1].item, roadmap.items[0].id);
|
||||
assert.equal(itemOf(slimIssue(pr(16, { body: "Fixes #1438" })), roadmap), "end-city-banners");
|
||||
});
|
||||
|
||||
test("the journal groups a release's changes by roadmap item and lists what awaits a release", () => {
|
||||
const releases = [
|
||||
{ tag_name: "v0.2.2", name: "Horizon 0.2.2: Rich presence", published_at: "2030-01-02T00:00:00Z", html_url: "u2", body: "### New\n- Discord Rich Presence (#1787)\n\n### Fixed\n- A fix (#5, fixes #4)\n" },
|
||||
{ tag_name: "launcher@0.2.1", name: "Horizon launcher 0.2.1", published_at: "2030-01-01T00:00:00Z", html_url: "u1", body: "### Fixed\n- Window (#6)\n" },
|
||||
];
|
||||
const list = [
|
||||
pr(1788, { state: "closed", pull_request: { merged_at: "2030-01-03T00:00:00Z" } }),
|
||||
pr(7, { state: "closed", pull_request: { merged_at: "2030-01-03T00:00:00Z" }, labels: [{ name: "skip-release" }] }),
|
||||
].map(slimIssue);
|
||||
const entries = journalFrom(releases, list, { ...roadmap, journal: [] });
|
||||
assert.deepEqual(entries.map((e) => e.id), ["next-release", "v0.2.2", "launcher@0.2.1"]);
|
||||
assert.deepEqual(entries[0].changes.map((c) => [c.prs, c.item]), [[[1788], "discord-presence"]]);
|
||||
assert.deepEqual(entries[1].changes.map((c) => [c.section, c.text, c.item]), [["new", "Discord Rich Presence", "discord-presence"], ["fixed", "A fix", null]]);
|
||||
const html = journalHtml(entries, roadmap);
|
||||
assert.ok(html.includes('href="#discord-presence"'));
|
||||
assert.ok(html.includes("And 1 fix."));
|
||||
});
|
||||
|
||||
test("journal.json is the flat feed Kira reads: merges, releases, shipped items, weeks, ids that never change", () => {
|
||||
const releases = [
|
||||
{ tag_name: "v0.2.48", name: "Horizon 0.2.48", published_at: "2030-01-02T00:00:00Z", html_url: "https://github.com/ludovic111/horizon/releases/tag/v0.2.48", body: "### New\n- Packs (#1)\n" },
|
||||
{ tag_name: "nightly-1", name: "Nightly", published_at: "2030-01-03T00:00:00Z", html_url: "u", body: "" },
|
||||
];
|
||||
const list = [
|
||||
pr(1788, { state: "closed", pull_request: { merged_at: "2030-01-04T00:00:00Z" }, html_url: "https://github.com/ludovic111/horizon/pull/1788" }),
|
||||
pr(7, { state: "closed", pull_request: { merged_at: "2030-01-04T00:00:00Z" }, labels: [{ name: "skip-release" }] }),
|
||||
pr(8, { state: "closed", pull_request: { merged_at: "2030-01-04T00:00:00Z" }, labels: [{ name: "skip-release" }, { name: "roadmap:lean-code" }] }),
|
||||
pr(9),
|
||||
].map(slimIssue);
|
||||
const week = { week: "2030-01", date: "2029-12-31", title: "A week", plain: "p", dev: "d" };
|
||||
const feed = journalJson(releases, list, { ...roadmap, journal: [week] }, "2030-01-05T00:00:00Z");
|
||||
const byId = new Map(feed.entries.map((e) => [e.id, e]));
|
||||
// A merged pull request, with its roadmap item; skip-release ones only when they move an item; open ones never.
|
||||
assert.deepEqual(byId.get("pr-1788"), { id: "pr-1788", kind: "merge", date: "2030-01-04T00:00:00Z", title: "PR 1788", url: "https://github.com/ludovic111/horizon/pull/1788", number: 1788, item: "discord-presence", item_title: "Discord Rich Presence" });
|
||||
assert.ok(!byId.has("pr-7") && byId.get("pr-8").item === "lean-code" && !byId.has("pr-9"));
|
||||
// Game and launcher releases only.
|
||||
assert.equal(byId.get("release-v0.2.48").tag, "v0.2.48");
|
||||
assert.ok(!byId.has("release-nightly-1"));
|
||||
// Every shipped item, dated by its release when the feed has it, with its post and the announce flag.
|
||||
const shipped = roadmap.items.filter((i) => i.status === "shipped");
|
||||
for (const item of shipped) {
|
||||
const e = byId.get(`shipped-${item.id}`);
|
||||
assert.equal(e.kind, "shipped");
|
||||
assert.equal(e.url, `https://playhorizon.dev/hub#${item.id}`);
|
||||
assert.ok(e.post.length <= 240 && typeof e.announce === "boolean", item.id);
|
||||
}
|
||||
assert.equal(byId.get("shipped-server-resource-packs").date, "2030-01-02T00:00:00Z");
|
||||
assert.equal(byId.get("weekly-2030-01").date, "2030-01-06T23:59:59.000Z");
|
||||
// Newest first; every entry has what Kira needs, and links only where Kira shows them.
|
||||
assert.deepEqual(feed.entries.map((e) => e.date), feed.entries.map((e) => e.date).sort().reverse());
|
||||
for (const e of feed.entries) {
|
||||
assert.ok(e.id && ["merge", "release", "weekly", "shipped"].includes(e.kind) && e.date && e.title, e.id);
|
||||
assert.match(e.url, /^https:\/\/(github\.com|playhorizon\.dev)\//, e.id);
|
||||
}
|
||||
});
|
||||
|
||||
test("items still to come take votes and suggestions; shipped ones don't", () => {
|
||||
const html = roadmapHtml(roadmap);
|
||||
for (const item of roadmap.items) {
|
||||
assert.equal(html.includes(`data-vote="${item.id}"`), item.status !== "shipped", item.id);
|
||||
assert.equal(suggestItemsHtml(roadmap).includes(`value="${item.id}"`), item.status !== "shipped", item.id);
|
||||
}
|
||||
// Hidden until the hub's server answers.
|
||||
assert.ok(html.includes('aria-pressed="false" hidden>'));
|
||||
});
|
||||
|
||||
test("the contributors carry the Discord name of those who agreed on Kira", () => {
|
||||
const github = [{ login: "Alex", html_url: "https://github.com/Alex", avatar_url: "", contributions: 3 }, { login: "sam", html_url: "https://github.com/sam", avatar_url: "", contributions: 1 }];
|
||||
const kira = { contributors: [{ github: "alex", discord: "Alex <b>" }, { github: 5 }, null] };
|
||||
const credit = creditFrom(github, kira);
|
||||
assert.deepEqual(credit.map((c) => c.discord), ["Alex <b>", ""]);
|
||||
const html = creditHtml(credit);
|
||||
assert.ok(html.includes("3 commits · Alex <b> on Discord") && html.includes("1 commit</span>"));
|
||||
assert.deepEqual(creditFrom(github, "not json").map((c) => c.discord), ["", ""]);
|
||||
});
|
||||
+36
-3
@@ -1,5 +1,5 @@
|
||||
// A small Markdown renderer for release notes and the README: headings, paragraphs,
|
||||
// lists (nested by indentation), fenced code, quotes, rules, and inline code, bold,
|
||||
// A small Markdown renderer for release notes, the README and the docs: headings, paragraphs,
|
||||
// lists (nested by indentation), fenced code, quotes, rules, tables, and inline code, bold,
|
||||
// italic and links. Everything is escaped first, so its output never carries raw HTML.
|
||||
// Shared by build.mjs (Node) and main.js (browser).
|
||||
|
||||
@@ -38,12 +38,41 @@ export function inline(text, site = false) {
|
||||
out = out.replace(/\u0001(\d+)\u0001/g, (_, i) => {
|
||||
const [label, url] = links[i];
|
||||
const target = href(url, site);
|
||||
const body = inline(label, site);
|
||||
// The label's code spans are already placeholders: put them back for its own pass.
|
||||
const body = inline(label.replace(/\u0000(\d+)\u0000/g, (_, c) => `\`${codes[c]}\``), site);
|
||||
return target ? `<a href="${escape(target)}">${body}</a>` : body;
|
||||
});
|
||||
return out.replace(/\u0000(\d+)\u0000/g, (_, i) => `<code>${escape(codes[i])}</code>`);
|
||||
}
|
||||
|
||||
// A table: a row of cells, a rule row (`| --- | :-: |`), then body rows, until a line that isn't a row.
|
||||
const ROW = /^\s*\|.*\|\s*$/;
|
||||
const RULE = /^\s*\|(\s*:?-+:?\s*\|)+\s*$/;
|
||||
|
||||
/** A row's cells: split on `|` outside code spans; `\|` is a literal bar. */
|
||||
function cells(row) {
|
||||
const s = row.trim().slice(1, -1);
|
||||
const out = [""];
|
||||
let code = false;
|
||||
for (let i = 0; i < s.length; i++) {
|
||||
if (s[i] === "\\" && s[i + 1] === "|") out[out.length - 1] += s[++i];
|
||||
else if (s[i] === "|" && !code) out.push("");
|
||||
else {
|
||||
if (s[i] === "`") code = !code;
|
||||
out[out.length - 1] += s[i];
|
||||
}
|
||||
}
|
||||
return out.map((c) => c.trim());
|
||||
}
|
||||
|
||||
function table(lines, start, site) {
|
||||
const row = (line, tag) => `<tr>${cells(line).map((c) => `<${tag}>${inline(c, site)}</${tag}>`).join("")}</tr>`;
|
||||
let i = start + 2;
|
||||
const body = [];
|
||||
while (i < lines.length && ROW.test(lines[i])) body.push(row(lines[i++], "td"));
|
||||
return [`<div class="table-wrap"><table class="md-table"><thead>${row(lines[start], "th")}</thead><tbody>${body.join("")}</tbody></table></div>`, i];
|
||||
}
|
||||
|
||||
const indentOf = (line) => line.match(/^ */)[0].length;
|
||||
const ITEM = /^(\s*)([-*+]|\d+[.)])\s+(.*)$/;
|
||||
|
||||
@@ -131,6 +160,10 @@ export function markdown(source, { shift = 0, site = false, headings = null } =
|
||||
} else if (/^\s*([-*_])(\s*\1){2,}\s*$/.test(line)) {
|
||||
out.push("<hr>");
|
||||
i++;
|
||||
} else if (ROW.test(line) && RULE.test(lines[i + 1] || "")) {
|
||||
const [html, end] = table(lines, i, site);
|
||||
out.push(html);
|
||||
i = end;
|
||||
} else if (ITEM.test(line)) {
|
||||
const [html, end] = list(lines, i, site);
|
||||
out.push(html);
|
||||
|
||||
@@ -0,0 +1,25 @@
|
||||
// node --test src/: the Markdown the docs pages and release notes are rendered from.
|
||||
import { test } from "node:test";
|
||||
import assert from "node:assert/strict";
|
||||
import { markdown } from "./markdown.js";
|
||||
|
||||
test("a table renders with its header, cells and inline Markdown", () => {
|
||||
const html = markdown("| Way in | Status |\n| --- | :-: |\n| Rust | `cargo horizon-mod` |\n| Lua | planned \\| soon |\n\nAfter.");
|
||||
assert.equal(
|
||||
html,
|
||||
'<div class="table-wrap"><table class="md-table"><thead><tr><th>Way in</th><th>Status</th></tr></thead>' +
|
||||
"<tbody><tr><td>Rust</td><td><code>cargo horizon-mod</code></td></tr><tr><td>Lua</td><td>planned | soon</td></tr></tbody></table></div>\n<p>After.</p>",
|
||||
);
|
||||
});
|
||||
|
||||
test("a bar inside a code span stays in its cell", () => {
|
||||
assert.match(markdown("| a | b |\n|---|---|\n| `x | y` | z |"), /<td><code>x \| y<\/code><\/td><td>z<\/td>/);
|
||||
});
|
||||
|
||||
test("rows without a rule line are a paragraph", () => {
|
||||
assert.equal(markdown("| a | b |\n| c | d |"), "<p>| a | b | | c | d |</p>");
|
||||
});
|
||||
|
||||
test("a link whose label is code keeps it", () => {
|
||||
assert.equal(markdown("See [`AGENTS.md`](/docs/agents).", { site: true }), '<p>See <a href="/docs/agents"><code>AGENTS.md</code></a>.</p>');
|
||||
});
|
||||
+15
-1
@@ -79,6 +79,19 @@ function installHtml(p, v) {
|
||||
</ol>`;
|
||||
}
|
||||
|
||||
// GitHub's rule for a login: letters, digits and single dashes, at most 39.
|
||||
const LOGIN = /^(?!-)(?!.*--)[A-Za-z0-9-]{1,39}(?<!-)$/;
|
||||
|
||||
// Who publishes it: the GitHub accounts the registry checked when the project was submitted.
|
||||
export function ownersHtml(p) {
|
||||
const owners = (p.owners || []).filter((o) => LOGIN.test(o));
|
||||
if (!owners.length) return "";
|
||||
const links = owners
|
||||
.map((o) => `<a class="mod-owner" href="https://github.com/${o}"><img src="https://avatars.githubusercontent.com/${o}?s=48" alt="" width="24" height="24" loading="lazy">@${o}</a>`)
|
||||
.join(" ");
|
||||
return `<p class="meta mod-owners">Published by ${links}</p>`;
|
||||
}
|
||||
|
||||
// One project's page.
|
||||
export function projectHtml(p) {
|
||||
const v = p.versions[0];
|
||||
@@ -93,7 +106,7 @@ export function projectHtml(p) {
|
||||
.map((x) => `<li><strong>${escape(x.version)}</strong> <span class="mod-version">${escape(x.published || "")} · for ${escape(x.game)}${x.api ? ` · API ${escape(x.api)}` : ""}</span>${x.changelog ? `<div class="prose">${markdown(x.changelog)}</div>` : ""}</li>`)
|
||||
.join("");
|
||||
return `<article class="mod-page" data-id="${escape(p.id)}">
|
||||
<header class="mod-head">${icon(p)}<div><p class="kicker"><span>${escape(KIND_NAMES[p.kind] || p.kind)}</span>${escape((p.authors || []).join(", "))}</p>
|
||||
<header class="mod-head">${icon(p)}<div><p class="kicker"><span>${escape(KIND_NAMES[p.kind] || p.kind)}</span>${escape((p.authors || []).join(", "))}</p>${ownersHtml(p)}
|
||||
<h1 class="display page-title">${escape(p.name)}</h1><p class="lede">${escape(p.summary || "")}</p>
|
||||
<p class="mod-badges">${trust(p)} <span class="badge">${escape(p.license)}</span> <span class="badge">${escape(v.version)}</span>${v.side ? ` <span class="badge">${escape(v.side)}</span>` : ""}</p></div></header>
|
||||
${p.description ? `<div class="prose">${markdown(p.description)}</div>` : ""}
|
||||
@@ -121,6 +134,7 @@ export function submitHtml() {
|
||||
return `<p class="kicker"><span>Mods</span>Submit</p>
|
||||
<h1 class="display page-title">Submit to the registry</h1>
|
||||
<p class="lede">A mod, a modpack of registry mods, or a resource pack made for Horizon. The form checks the file and opens a pull request; a reviewer reads it, its source and the checks' report, and merging publishes it to this site and the launcher.</p>
|
||||
<p class="meta">First time? <a href="/docs/publish-a-mod">Publish a mod</a> walks through building, checking and signing the file, and <a href="/docs/make-a-mod">Make a mod</a> starts from the beginning.</p>
|
||||
<div class="mod-auth" id="submit-auth" aria-live="polite">
|
||||
<p class="meta no-script">The form needs JavaScript. You can also <a href="${REGISTRY}">open a pull request by hand</a>.</p>
|
||||
</div>
|
||||
|
||||
@@ -53,3 +53,11 @@ test("the submit form sends what the service reads", () => {
|
||||
assert.equal(entry.icon, undefined);
|
||||
assert.equal(JSON.parse(JSON.stringify(entry)).key, undefined, "an empty key isn't sent");
|
||||
});
|
||||
|
||||
test("a project's page links its owners' GitHub profiles, and only valid logins", () => {
|
||||
const html = projectHtml(project({ owners: ["Stink-O", "bad login", "-x", "a--b", "ok\"><script>"] }));
|
||||
assert.ok(html.includes('href="https://github.com/Stink-O"'));
|
||||
assert.ok(html.includes("@Stink-O"));
|
||||
for (const bad of ["bad login", "github.com/-x", "a--b", "<script>"]) assert.ok(!html.includes(bad), bad);
|
||||
assert.ok(!projectHtml(project()).includes("Published by"));
|
||||
});
|
||||
|
||||
+131
-1
@@ -645,7 +645,7 @@ code { border-radius: 0; background: var(--well); box-shadow: 0 0 0 1px var(--ou
|
||||
|
||||
/* Releases: a filter, then every release as a panel that opens. */
|
||||
.release-filter { display: flex; flex-wrap: wrap; gap: 8px; margin-top: 32px; }
|
||||
.release-filter .button[aria-pressed="true"] { background: var(--face); color: var(--on-face); box-shadow: inset 0 var(--block-bevel) 0 var(--face-bevel), inset 0 calc(-1 * var(--block-lip)) 0 var(--face-lip); }
|
||||
.release-filter .button[aria-pressed="true"], .hub-detail .button[aria-pressed="true"], .button.hub-vote[aria-pressed="true"] { background: var(--face); color: var(--on-face); box-shadow: inset 0 var(--block-bevel) 0 var(--face-bevel), inset 0 calc(-1 * var(--block-lip)) 0 var(--face-lip); }
|
||||
.release-count { margin: 16px 0 12px; }
|
||||
.release-list { display: grid; gap: 8px; }
|
||||
.release-list .release + .release { margin-top: 0; }
|
||||
@@ -687,6 +687,10 @@ code { border-radius: 0; background: var(--well); box-shadow: 0 0 0 1px var(--ou
|
||||
.bench-table td.num { font-variant-numeric: tabular-nums; white-space: nowrap; }
|
||||
.bench-table td.wins { color: var(--ink); font-weight: 600; }
|
||||
.bench-table td.vs { font-size: var(--text-caption); white-space: nowrap; }
|
||||
.md-table { width: 100%; border-collapse: collapse; font-size: var(--text-ui); }
|
||||
.md-table th, .md-table td { padding: 8px 12px 8px 0; text-align: left; border-bottom: 1px solid var(--rule); vertical-align: baseline; }
|
||||
.md-table th { font-weight: 500; color: var(--ink); }
|
||||
.md-table td code, .md-table th code { overflow-wrap: anywhere; }
|
||||
.vs-horizon { color: var(--success); }
|
||||
.vs-java { color: var(--danger); }
|
||||
.vs-tie, .vs-none { color: var(--muted); }
|
||||
@@ -727,6 +731,129 @@ code { border-radius: 0; background: var(--well); box-shadow: 0 0 0 1px var(--ou
|
||||
.machine { padding: 16px; }
|
||||
}
|
||||
|
||||
/* --- The hub (/hub): tabs, the Simple / Technical switch, roadmap items as panels ------------------- */
|
||||
|
||||
.hub-bar { display: flex; flex-wrap: wrap; align-items: center; justify-content: space-between; gap: 16px; margin-top: 32px; }
|
||||
.hub-tabs { margin-bottom: 0; }
|
||||
.hub-detail { display: flex; gap: 8px; }
|
||||
/* A link to a tab (/hub#roadmap) lands with the tabs in view under the top bar. */
|
||||
.hub-panel { margin-top: 40px; scroll-margin-top: calc(var(--nav) + 120px); }
|
||||
.js .hub-panel:not(.is-active) { display: none; }
|
||||
/* Simple shows `plain`, Technical shows `dev`; without the switch (no JavaScript) Simple reads. */
|
||||
.hub .hub-dev { display: none; }
|
||||
:root[data-detail="dev"] .hub .hub-dev { display: block; }
|
||||
:root[data-detail="dev"] .hub .hub-plain { display: none; }
|
||||
.hub-lead { max-width: 60ch; font-size: var(--text-heading); line-height: var(--text-heading-line); color: var(--ink); }
|
||||
.hub-block { margin-top: 56px; }
|
||||
.hub-block > .title { margin-bottom: 16px; }
|
||||
.hub-intro { margin-bottom: 16px; color: var(--ink-soft); max-width: var(--measure); }
|
||||
.hub-rows .row > a { grid-template-columns: var(--index) minmax(0, 1fr) auto; align-items: baseline; }
|
||||
.hub-row-body { display: grid; gap: 4px; min-width: 0; }
|
||||
.hub-row-title { font-size: clamp(18px, 1.8vw, 22px); font-weight: 500; color: var(--ink); }
|
||||
.hub-row-body .hub-plain, .hub-row-body .hub-dev { color: var(--ink-soft); font-size: var(--text-ui); max-width: 80ch; }
|
||||
.hub-rows .row-meta { max-width: 16rem; }
|
||||
.hub-section { margin-top: 48px; }
|
||||
.hub-section-head { display: flex; flex-wrap: wrap; align-items: baseline; gap: 8px 20px; }
|
||||
.hub-items { display: grid; grid-template-columns: repeat(auto-fill, minmax(min(100%, 340px), 1fr)); gap: 8px; margin-top: 16px; }
|
||||
.hub-item {
|
||||
display: flex; flex-direction: column; gap: 10px; padding: 18px 20px; scroll-margin-top: calc(var(--nav) + 24px);
|
||||
background: var(--panel); border: var(--block-outline) solid var(--outline); box-shadow: var(--panel-edges);
|
||||
}
|
||||
.hub-item:target { box-shadow: var(--panel-edges), 0 0 0 3px var(--accent); }
|
||||
.hub-item-meta { display: flex; flex-wrap: wrap; align-items: center; gap: 6px; }
|
||||
.hub-item-meta .badge { margin-right: 0; }
|
||||
.hub-ongoing { font: var(--text-micro) / 1 var(--mono); letter-spacing: var(--text-micro-tracking); color: var(--muted); }
|
||||
.hub-item-title { font-size: var(--text-heading); line-height: var(--text-heading-line); }
|
||||
.hub-item .hub-plain, .hub-item .hub-dev { font-size: var(--text-ui); color: var(--ink-soft); }
|
||||
.hub-progress { font: var(--text-micro) / 1.4 var(--mono); letter-spacing: var(--text-micro-tracking); color: var(--ink); }
|
||||
.hub-links { display: flex; flex-wrap: wrap; gap: 6px; margin-top: auto; padding-top: 4px; }
|
||||
.hub-link {
|
||||
display: inline-flex; gap: 6px; align-items: baseline; padding: 3px 7px; font: var(--text-micro) / 1.3 var(--mono);
|
||||
color: var(--ink-soft); background: var(--well); box-shadow: 0 0 0 var(--block-outline) var(--outline);
|
||||
}
|
||||
.hub-link span { color: var(--muted); }
|
||||
.hub-link:hover { color: var(--accent); }
|
||||
.hub-link.is-merged { background: color-mix(in srgb, var(--success) 18%, var(--well)); }
|
||||
.hub-link.is-in-review { background: color-mix(in srgb, var(--accent) 18%, var(--well)); }
|
||||
.hub-link.is-in-progress { background: color-mix(in srgb, var(--warn) 22%, var(--well)); }
|
||||
.hub-link.is-merged span, .hub-link.is-in-review span, .hub-link.is-in-progress span { color: var(--ink); }
|
||||
.hub-cards { display: grid; grid-template-columns: repeat(auto-fill, minmax(min(100%, 260px), 1fr)); gap: 8px; }
|
||||
.hub-cards .highlight { justify-content: flex-start; }
|
||||
.hub-cards h3 { font-size: var(--text-heading); line-height: var(--text-heading-line); }
|
||||
.hub-cards p { color: var(--ink-soft); font-size: var(--text-ui); }
|
||||
.hub-actions { display: flex; flex-wrap: wrap; gap: 8px; margin-top: 16px; }
|
||||
.hub-cards .hub-actions { margin-top: auto; }
|
||||
.hub-rules { list-style: decimal; padding-left: 20px; max-width: var(--measure); }
|
||||
.hub-rules li + li { margin-top: 10px; }
|
||||
.hub-rules li::marker { color: var(--muted); font-family: var(--mono); }
|
||||
.hub-source { margin-top: 40px; max-width: var(--measure); }
|
||||
.hub-board-head { display: flex; flex-wrap: wrap; align-items: center; justify-content: space-between; gap: 12px 24px; }
|
||||
.hub-board-head .hub-intro { margin-bottom: 0; }
|
||||
.hub-select { display: inline-flex; align-items: center; gap: 10px; }
|
||||
.hub-select select {
|
||||
height: 32px; max-width: 22rem; padding: 0 10px; font: var(--text-label) / 1 var(--font); color: var(--ink);
|
||||
background: var(--well); border: 0; box-shadow: 0 0 0 var(--block-outline) var(--outline);
|
||||
}
|
||||
.hub-board { display: grid; grid-template-columns: repeat(4, minmax(0, 1fr)); gap: 8px; margin-top: 24px; align-items: start; }
|
||||
.hub-column { padding: 14px; background: var(--panel); border: var(--block-outline) solid var(--outline); box-shadow: var(--panel-edges); }
|
||||
.hub-column h3 { display: flex; justify-content: space-between; align-items: baseline; font-size: var(--text-heading); }
|
||||
.hub-count { font: var(--text-micro) / 1 var(--mono); color: var(--muted); }
|
||||
.hub-column > .meta { margin: 6px 0 12px; }
|
||||
.hub-cards-list { display: grid; gap: 6px; }
|
||||
.js .hub-column:not(.is-open) .hub-card[data-more] { display: none; }
|
||||
.hub-card a { display: grid; gap: 4px; padding: 10px 12px; background: var(--well); box-shadow: 0 0 0 var(--block-outline) var(--outline); color: var(--ink); }
|
||||
.hub-card a:hover { box-shadow: 0 0 0 var(--block-outline) var(--accent); }
|
||||
.hub-card-ref, .hub-card-meta { font: var(--text-micro) / 1.4 var(--mono); letter-spacing: var(--text-micro-tracking); color: var(--muted); }
|
||||
.hub-card-title { font-size: var(--text-label); line-height: 1.4; overflow-wrap: anywhere; }
|
||||
.hub-card-meta { display: flex; flex-wrap: wrap; gap: 4px 10px; }
|
||||
.hub-card-item { color: var(--accent); }
|
||||
.hub-more { margin-top: 10px; width: 100%; justify-content: center; }
|
||||
.hub-journal { display: grid; gap: 8px; margin-top: 24px; max-width: 56rem; }
|
||||
.hub-entry { display: grid; gap: 10px; padding: 18px 20px; background: var(--panel); border: var(--block-outline) solid var(--outline); box-shadow: var(--panel-edges); scroll-margin-top: calc(var(--nav) + 24px); }
|
||||
.hub-entry-week { background: color-mix(in srgb, var(--accent) 8%, var(--panel)); }
|
||||
.hub-entry-meta { display: flex; align-items: center; gap: 10px; font: var(--text-micro) / 1 var(--mono); color: var(--muted); }
|
||||
.hub-entry-meta .badge { margin-right: 0; }
|
||||
.hub-entry-title { font-size: var(--text-heading); line-height: var(--text-heading-line); }
|
||||
.hub-entry-title a { color: var(--ink); }
|
||||
.hub-entry-title a:hover { color: var(--accent); }
|
||||
.hub-entry .hub-plain, .hub-entry .hub-dev { font-size: var(--text-ui); color: var(--ink-soft); }
|
||||
.hub-entry-items { display: flex; flex-wrap: wrap; gap: 6px; }
|
||||
.hub-shipped { font-size: var(--text-ui); color: var(--ink); }
|
||||
.hub-changes { list-style: square; padding-left: 18px; font-size: var(--text-ui); color: var(--ink-soft); }
|
||||
.hub-changes li + li { margin-top: 4px; }
|
||||
.hub-ref { font: var(--text-micro) / 1 var(--mono); }
|
||||
.hub-group { margin-top: 8px; font: 500 var(--text-label) / 1.4 var(--font); }
|
||||
.hub-group:first-child { margin-top: 0; }
|
||||
@media (max-width: 1100px) { .hub-board { grid-template-columns: repeat(2, minmax(0, 1fr)); } }
|
||||
@media (max-width: 720px) {
|
||||
.hub-board { grid-template-columns: minmax(0, 1fr); }
|
||||
.hub-rows .row > a { grid-template-columns: var(--index) minmax(0, 1fr); }
|
||||
.hub-rows .row-meta { grid-column: 2; text-align: left; }
|
||||
}
|
||||
|
||||
/* --- Hub: votes, the report and suggestion forms, the contributors ---------------------- */
|
||||
.hub-vote { margin-left: auto; }
|
||||
.hub-vote-count { margin-left: -2px; }
|
||||
.hub-vote-count:empty { display: none; }
|
||||
.hub-form { display: grid; gap: 16px; max-width: 46rem; margin-top: 8px; }
|
||||
.hub-form-pair { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 16px; }
|
||||
.hub-field { display: grid; gap: 6px; font-size: var(--text-label); color: var(--ink-soft); }
|
||||
.hub-field input, .hub-field textarea, .hub-field select {
|
||||
width: 100%; min-height: 36px; padding: 8px 10px; font: var(--text-ui) / 1.4 var(--font); color: var(--ink);
|
||||
background: var(--well); border: 0; box-shadow: 0 0 0 var(--block-outline) var(--outline);
|
||||
}
|
||||
.hub-field textarea { resize: vertical; }
|
||||
.hub-field input:focus-visible, .hub-field textarea:focus-visible, .hub-field select:focus-visible { outline: 1px solid var(--accent); outline-offset: 2px; }
|
||||
.hub-field input::placeholder, .hub-field textarea::placeholder { color: var(--muted); }
|
||||
.hub-trap { position: absolute; left: -10000px; width: 1px; height: 1px; overflow: hidden; }
|
||||
.hub-form-foot { display: flex; flex-wrap: wrap; align-items: center; gap: 8px 16px; }
|
||||
.hub-form-foot [data-status] { color: var(--ink); }
|
||||
.hub-form-foot .button:disabled { opacity: 0.4; cursor: default; }
|
||||
.hub-form-closed { color: var(--ink-soft); }
|
||||
@media (max-width: 720px) {
|
||||
.hub-form-pair { grid-template-columns: minmax(0, 1fr); }
|
||||
}
|
||||
|
||||
/* The registry (/mods): a search and the kind filter, rows as panels, then a page per project. */
|
||||
.mod-actions { display: flex; flex-wrap: wrap; gap: 8px; margin-top: 24px; }
|
||||
.mod-tools { display: flex; flex-wrap: wrap; align-items: center; gap: 16px; margin-top: 32px; }
|
||||
@@ -759,6 +886,9 @@ code { border-radius: 0; background: var(--well); box-shadow: 0 0 0 1px var(--ou
|
||||
.mod-page { display: grid; gap: 16px; max-width: calc(var(--measure) + 240px); }
|
||||
.mod-page .heading { margin-top: 24px; }
|
||||
.mod-head { display: grid; grid-template-columns: 96px minmax(0, 1fr); gap: 24px; align-items: start; }
|
||||
.mod-owners { display: flex; flex-wrap: wrap; align-items: center; gap: 8px; margin: 4px 0 0; }
|
||||
.mod-owner { display: inline-flex; align-items: center; gap: 6px; }
|
||||
.mod-owner img { border-radius: 50%; }
|
||||
.mod-head .mod-icon { width: 96px; height: 96px; font-size: 44px; }
|
||||
.mod-head .page-title { margin-top: 0; }
|
||||
.mod-badges { margin-top: 16px; }
|
||||
|
||||
Reference in New Issue
Block a user