From 6776954a3ca4d1be3c02a631cfbb51f51539ba9b Mon Sep 17 00:00:00 2001 From: Craig Oates Date: Thu, 29 Feb 2024 22:42:45 +0000 Subject: [PATCH] create roomies-manchester.org file. --- roomies-manchester.org | 53 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 53 insertions(+) create mode 100644 roomies-manchester.org diff --git a/roomies-manchester.org b/roomies-manchester.org new file mode 100644 index 0000000..a2b6eb4 --- /dev/null +++ b/roomies-manchester.org @@ -0,0 +1,53 @@ +#+options: ':nil *:t -:t ::t <:t H:3 \n:nil ^:t arch:headline author:t +#+options: broken-links:nil c:nil creator:nil d:(not "LOGBOOK") date:t e:t +#+options: email:nil expand-links:t f:t inline:t num:t p:nil pri:nil prop:nil +#+options: stat:t tags:t tasks:t tex:t timestamp:t title:t toc:t todo:t |:t +#+title: Roomies Manchester +#+date: \today +#+author: Craig Oates +#+email: craig@craigoates.net +#+language: en +#+select_tags: export +#+exclude_tags: noexport +#+creator: Emacs 29.1.90 (Org mode 9.7-pre) +#+cite_export: + +* Gather Roomie Data (Manually) + +- [[https://www.roomies.co.uk/][Roomies]] + +The website requires you to create an account for full access to the site's +listings. With that said, it does provide enough listings to chart the data. The +amount of listings is tiny, compared to [[file:./spare-room-manchester.org][Spare Room]] (Manc.) and [[file:./right-move-manchester.org][Right Move]] +(Manc.). So, I've downloaded the HTML manually, and going to process that data +instead. The search filters I used: + +- Date: 2024-02-29 +- Location: Manchester +- Price Range: £0–1200 + +There are only twenty-three listings. I’ve stored the HTML is +=raw-data/external/2024-02-29_roomies-manc/=. As is standard behaviour at this +point, I won’t be committing that data to the repositories commit history. + +* Setup Common Lisp Environment + +I’ve copied the following code block over from other files. Run it if this is +your first file open in the session. + +#+begin_src lisp :session :results silent + (ql:quickload :com.inuoe.jzon) ; JSON parser. + (ql:quickload :dexador) ; HTTP requests. + (ql:quickload :plump) ; HTML/XML parser. + (ql:quickload :lquery) ; HTML/DOM manipulation. + (ql:quickload :lparallel) ; Parallel programming. + (ql:quickload :cl-ppcre) ; RegEx. library. + (ql:quickload :plot/vega) ; Vega plotting library. + (ql:quickload :lisp-stat) ; Stat's library. + (ql:quickload :data-frame) ; Data frame library eqv. to Python's Numpy. + (ql:quickload :str) ; String library, expands on 'string' library. +#+end_src + +* TODO Clean Up and Parse Data + +This bit I need to start work on.