HOWTO: Sort BitWarden Passwords by Date

@edent — Wed, 14 Feb 2024 12:34:30 +0000

I highly recommend BitWarden as a password manager. It is free, open source, and has a great range of apps and APIs.

The one thing it doesn't have is a way to sort your accounts by creation date. I now have over a thousand accounts that I've added - so I wanted to prune away some of the older ones.

So, here's how to do it.

Export your vault

In the desktop version of BitWarden, go to File → Export Vault. Choose the JSON format (this doesn't work for CSV) and follow the on-screen instructions.

NOTE! This will save all of your passwords to disk. Do not do this on a shared machine. Delete the file as soon as you are done with it.

Sort with JQ

Using the jq utility it is possible to search and sort the exported JSON.

This command pipes your export to JQ. It selects all the items, then it sorts by when the item was last edited. It then displays the name of the account and the date, followed by a newline.

cat bitwarden.json | jq -r '.items | sort_by(.revisionDate) | .[] | .name, .revisionDate, " " '

Purge!

You could use the API to delete items based on their ID. Personally, I'd rather go through manually.

What's next?

It would be great if BitWarden allowed sorting by date in their UI. Even better if they could sort by usage. Until then, I'll spend every Valentine's Day manually deleting old and unloved accounts.

KYLI - because it is superior to JSON

@edent — Tue, 21 Mar 2017 12:08:04 +0000

This is a (silly) attempt to fix some of the shortcomings of JSON. Hence it is named after the goddess of music.

It uses C0 Control Characters

Here is an example:

␜
   ␁
      This is a KYLI document
   ␂
      ␝ GroupName
         ␞ data ␟ value
         ␛ Comments are supported too!
         They can be multilined easily.
␙

I've used Unicode Control Pictures so you can see what's happening. In reality, ␜ is - which on your display looks like .

Why KYLI is 100x better than crummy JSON

JSON is ok, I guess. But it is fragile - breaking if a comma is out of place. It is also really hard to use with text; you either have to escape every " or ' - or remember to HTML encode (and decode) everything. It doesn't have comments. There's no versioning.

KYLI attempts to improve on some of those shortcomings. Here's how it works.

Philosophy

Magic characters control the flow of the document.
A magic character is terminated by the presence of another magic character. This means...
Whitespace is a first class citizen. It can be used in names, values, comments.
The only characters which can't be used within names and values are magic characters.
1. Every other Unicode character is available for names, data, values, comments.
There are no "types" - everything is a string.
1. If you want to use an alternative numbering system, or use ⊨ and ⊭ for boolean, that's encouraged.

Structure

KYLI:

Will start with ␜ File Separator.
May have a header - indicated with ␁
- A header can contain any pertinent information. For example, KYLI version or document metadata.
- Headers are unstructured. They can hold any valid text (including XML or JSON).
Will indicate the start of the data using ␂ Start of Text.
May contain data:
- A datum's name will start with ␞ Record Separator.
- A datum's value will start with ␟ Unit Separator.
- All values are Unicode strings. There is no concept of number types or booleans.
- Data may be grouped:
  - The group's name will start with ␝ Group Separator.
  - There is no limit to how many subgroups there may be.
Will end with ␙ End of Medium.

Examples

It is helpful to think of KYLI as a stream of Unicode characters. When viewing a document, you may want to "pretty print" it for your convenience.

Basic

The minimum viable KYLI is something like:

␜␞age␟42␙

Multi-lingual

Names can be any valid Unicode string (that is, which doesn't contain control characters).

␜
   ␁
      Generated on 2017-03-25
   ␂
      ␝ People's names
         ␝ 英国人
            ␛ That's the Chinese word for
              "English People"
            ␝ 123456
               ␞ Name ␟ Terence Eden
            ␝ 789456
               ␞ Name ␟ John Lennon
␙

Which is transmitted as

␜␁Generated on 2017-03-25␂␝Different People␝英国人␛That's the Chinese word for
"English People"␝123456␞Name␟Terence Eden␝789456␞Name␟John Lennon␙

Multiline data easily

␜
   ␂
      ␞ HTML for the site ␟ 

   
       
      ...
      ␞ date ␟ 2018-01-15
␙
</code></pre>

<h2 id="why-this-is-better"><a href="https://shkspr.mobi/blog/2017/03/kyli-because-it-is-superior-to-json/#why-this-is-better">Why this is better</a></h2>

<ul>
<li>It discourages editing by hand! You should be using tools to create data or config files. They can verify their validity quicker and more accurately than any human. </li>
<li>You don't need to worry about escaping "special" characters like <code>"</code>!</li>
<li>Comments!</li>
<li>No worrying about data types!</li>
<li>More compact!</li>
<li>No bloody commas tripping things up!</li>
<li>Metadata!</li>
<li>No confusion over whether something is an object, array, or string!</li>
<li>Easier to validate!</li>
</ul>

<p>I am confident that KYLI will supplant JSON <del>in the 1990s pop charts</del> as the preferred data transmission standard of the 21<sup>st</sup> Century.</p>

<p><a href="https://www.flickr.com/photos/evarinaldiphotography/6805204016/"></a></p>

</article>
<article>
<h1>YQL and The Pirate Bay</h1>
<p>@edent — Wed, 02 May 2012 07:17:55 +0000</p>
<p>For reasons best known to themselves, certain sections of the entertainment industries seem to believe that <del datetime="2012-05-01T08:34:33+00:00">bolting the stable door</del> <a href="http://www.guardian.co.uk/technology/2012/apr/30/british-isps-block-pirate-bay">shutting down The Pirate Bay will stop all piracy</a>.</p>

<p>It's as though they think that people won't be able to use a proxy, circumvent the <a href="http://en.wikipedia.org/wiki/Cleanfeed_%28content_blocking_system%29">Cleanfeed</a> block, or simply use a search engine to find another torrent site.</p>

<h2 id="build-your-own-pirate-bay"><a href="https://shkspr.mobi/blog/2012/05/yql-and-the-pirate-bay/#build-your-own-pirate-bay">Build Your Own Pirate Bay?</a></h2>

<p>Proxying is a very simple concept.</p>

<ul>
    <li>Alice is forbidden from speaking to Bob.</li>
    <li>Alice can speak to Eve.</li>
    <li>Eve can speak to Bob.</li>
    <li>Alice, therefore, can use Eve to communicate with Bob.</li>
</ul>

<p>So, a user who wishes to access The Pirate Bay would have to do something quite complex to use a proxy?  No, this is all there is to it:</p>

<pre>SELECT * FROM html
WHERE url="https://thepiratebay.se/search/ubuntu/0/7/0"
AND xpath='//tr'</pre>

<p>This uses YQL and xpath to extract all the information from a Pirate Bay search (in this case, for Ubuntu - which is legally distributed through Bit Torrent).</p>

<p>Simply, this asks Yahoo (an American site) to contact The Pirate Bay (a Swedish site) to deliver information to a user in Britain.</p>

<p>You can play with the results yourself <a href="https://web.archive.org/web/20120504160649/http://developer.yahoo.com/yql/console/">in the Yahoo Console</a>.</p>

<p>This returns a JSON string which can then be easily parsed (e.g. using jQuery). Simple.</p>

<h2 id="aha-but-what-about-downloading-a-torrent"><a href="https://shkspr.mobi/blog/2012/05/yql-and-the-pirate-bay/#aha-but-what-about-downloading-a-torrent">Aha! But What About Downloading A Torrent?</a></h2>

<p>In the olden days (well, last year) there was a fly in the ointment.  You had to download a .torrent file from the website. That meant that you needed a way to connect to, in this case, The Pirate Bay or find a proxy which was willing to transfer files.</p>

<p>Nowadays, people use the <a href="http://en.wikipedia.org/wiki/Magnet_URI_scheme">magnet protocol</a>.  Here's what a magnet link looks like:</p>

<pre>magnet:?xt=urn:btih:fa692da0488aee23e5eb605a87be934ad7cec106</pre>

<p>Short enough to fit into a text message and, handily, can be embedded in an HTML document with no need to download an extra file.  Paste those 60 characters into your torrent client, and it will connect to the cloud and start downloading the file you requested.</p>

<p>So, a single web request to Yahoo and a line of JavaScript code is all it takes to circumvent this blockade.</p>

<h2 id="next-move"><a href="https://shkspr.mobi/blog/2012/05/yql-and-the-pirate-bay/#next-move">Next Move</a></h2>

<p>So, do the UK courts need to order ISPs to block Yahoo as well?  Or play whack-a-mole with all the new torrent sites springing up?  Let's not forget, in 2004 the huge Bit Torrent search engine <a href="http://en.wikipedia.org/wiki/Suprnova">Suprnova</a> was sued out of existence. Just like with the Hyrda, a decapitation lead to multiple sites springing up.</p>

<p>Piracy is a problem of convenience.  A pirated copy is</p>

<ul>
    <li>Faster to download.</li>
    <li>Quicker to watch (no unskipable trailers).</li>
    <li>More convenient to transfer to different devices.</li>
    <li>Global availability (no artificial regional restrictions).</li>
    <li>Immense back-catalogue (Star Wars, for example).</li>
    <li>Cheaper.</li>
</ul>

<p>The only downsides are that they are often of dubious legality, and occasionally of poor quality.</p>

<p>The entertainment industries have to compete on <strong>all these points</strong>.  I'll admit, that they will almost certainly not be able to compete with "free" - although monthly unlimited subscriptions come close.</p>

<p>The rest are problems of their own making.  I described how <a href="https://shkspr.mobi/blog/2009/05/the-10th-aniversary-of-the-death-of-the-modern-film-industry/">I downloaded The Phantom Menace back in 1999</a>.  13 long years later and the movie industry still isn't even close to where it needs to be.</p>

<p>Amazon have done pretty well from selling raw MP3s - a simple web interface, pay a small bit of money, instant high-quality download which is DRM free.  Where's the equivalent for films? Or for TV? Or radio?</p>

<p>The pernicious restrictions around geography also must end.  I want to watch Veep just as much as the Americans do. Why do I have to wait even an hour, let alone a week?</p>

<p>Finally, Star Wars <em>still</em> isn't available to (legally) download.  If I have a hankering for Jar Jar Binks at 3AM, I have to order a DVD and wait while it is physically transported from a warehouse. That's such a 19th Century way of thinking that it hurts my brain.</p>

<p>Get all that right and maybe - just maybe - the "piracy problem" will solve itself.</p>

<p>Of course, alternatively, it may be too late.  For 13 years people have been used to downloading without paying.  That's a long period of learned behaviour.  How content providers can convince people to change the habit of a lifetime is beyond my knowledge.</p>

</article>
</main></body></html>

json – Terence Eden’s Blog

HOWTO: Sort BitWarden Passwords by Date

KYLI - because it is superior to JSON