search.nixos.org

This repository contains the scripts and the web application for search.nixos.org.

How this project came to be

Initial idea was to replace NixOS packages and options search which was fetching one JSON file which contained all packages (or options). This approach is good for its simple setup, but started to show its problems when packages number was getting bigger and bigger. I'm sure we could optimize it further, but ideas what all could we do if there would be some database in the back were to tempting not to try.

For backend we are using Elasticsearch instance which is kindly sponsored by bonsai.io. On the frontend we are using Elm.

How search works?

The use case we want to solve is that a visitor want to see if a package exists or to look up certain package's details.

A user wants to converge to a single result if possible. The more characters are added to a search query the more narrow is search is and we should show less results.

Very important is also ranking of search results. This will bring more relevant search results to the top, since a lot of times it is hard to produce search query that will output only one result item.

A less important, but providing better user experience. are suggestions for writing better search query. Suggesting feature should guide user to write better queries which in turn will produce better results.

Ideas we want to explore

Apart from searching packages and options we would like to:

• Not only search for latest channels, but be enable to search in any evaluation. We need to explore how much in the past we can go, I'm sure we will have to make some compromises.
• Provide each maintainer with a page that lists packages that they maintain. A page - later - could also show his ticket and opened Pull Requests.
• Each package should have a page which would show versions in different evaluations/channels. It could also show - at one point - ticket that this package
• With all this information in the database it would be very useful to show some sort of reports. Few examples that come to my mind:
  • What packages and options were added/removed/changed between to evaluations? This could be useful for Release Manager when making release notes or just in general to see difference what has changed since last time.
  • How are we doing with tickets/pull requests? Burn-down chart maybe. The idea behind is to have a nicer view over current status of tickets/pull requests.

Probably there are more ideas I just need to remind myself to write them down.

Development

To start developing open a terminal and run:

$ nix-shell --run "yarn dev"

You can point your browser to http://localhost:3000 and start developing. Any changes to source files (./src) will trigger a hot reload of an application.

Deploying

• On each commit to master branch a GitHub Action is trigger.
• GitHub Action then builds production version of the web application using yarn prod command.
• The built web application (in ./dist) is then deployed to Netlify.
• GitHub Action can also be triggered via Pull Request, which if Pull Request was created from a non-forked repo's branch, will provide a preview url in a comment.