Craig Oates
2 months ago
1 changed files with 53 additions and 0 deletions
@ -0,0 +1,53 @@
|
||||
#+options: ':nil *:t -:t ::t <:t H:3 \n:nil ^:t arch:headline author:t |
||||
#+options: broken-links:nil c:nil creator:nil d:(not "LOGBOOK") date:t e:t |
||||
#+options: email:nil expand-links:t f:t inline:t num:t p:nil pri:nil prop:nil |
||||
#+options: stat:t tags:t tasks:t tex:t timestamp:t title:t toc:t todo:t |:t |
||||
#+title: Roomies Manchester |
||||
#+date: \today |
||||
#+author: Craig Oates |
||||
#+email: craig@craigoates.net |
||||
#+language: en |
||||
#+select_tags: export |
||||
#+exclude_tags: noexport |
||||
#+creator: Emacs 29.1.90 (Org mode 9.7-pre) |
||||
#+cite_export: |
||||
|
||||
* Gather Roomie Data (Manually) |
||||
|
||||
- [[https://www.roomies.co.uk/][Roomies]] |
||||
|
||||
The website requires you to create an account for full access to the site's |
||||
listings. With that said, it does provide enough listings to chart the data. The |
||||
amount of listings is tiny, compared to [[file:./spare-room-manchester.org][Spare Room]] (Manc.) and [[file:./right-move-manchester.org][Right Move]] |
||||
(Manc.). So, I've downloaded the HTML manually, and going to process that data |
||||
instead. The search filters I used: |
||||
|
||||
- Date: 2024-02-29 |
||||
- Location: Manchester |
||||
- Price Range: £0–1200 |
||||
|
||||
There are only twenty-three listings. I’ve stored the HTML is |
||||
=raw-data/external/2024-02-29_roomies-manc/=. As is standard behaviour at this |
||||
point, I won’t be committing that data to the repositories commit history. |
||||
|
||||
* Setup Common Lisp Environment |
||||
|
||||
I’ve copied the following code block over from other files. Run it if this is |
||||
your first file open in the session. |
||||
|
||||
#+begin_src lisp :session :results silent |
||||
(ql:quickload :com.inuoe.jzon) ; JSON parser. |
||||
(ql:quickload :dexador) ; HTTP requests. |
||||
(ql:quickload :plump) ; HTML/XML parser. |
||||
(ql:quickload :lquery) ; HTML/DOM manipulation. |
||||
(ql:quickload :lparallel) ; Parallel programming. |
||||
(ql:quickload :cl-ppcre) ; RegEx. library. |
||||
(ql:quickload :plot/vega) ; Vega plotting library. |
||||
(ql:quickload :lisp-stat) ; Stat's library. |
||||
(ql:quickload :data-frame) ; Data frame library eqv. to Python's Numpy. |
||||
(ql:quickload :str) ; String library, expands on 'string' library. |
||||
#+end_src |
||||
|
||||
* TODO Clean Up and Parse Data |
||||
|
||||
This bit I need to start work on. |
Loading…
Reference in new issue