How to handle slow drawing functions in quil functional mode - clojure

I am trying to build a cartographic quil visualization derivative of this bicycle station map animation. I am trying to use the new default functional mode in quil, because it looks like this handles a lot of the work of dealing with mouse events and updating the display. However, I am running into an issue where one part of the drawing (the background map) is taking far too long to render completely, even with a very low framerate.
Following the recommendation of this visualization, I am installing the UnfoldingMaps dependency by downloading it, and installing it into a leiningen localrepo as follows:
$ lein localrepo install /path/to/library/Unfolding.jar unfolding 0.9.6
$ lein localrepo install /path/to/library/json4processing.jar json4proc 0.9.6
My project.clj file looks like this:
(defproject transit-map "0.1.0-SNAPSHOT"
:description "FIXME: write description"
:url "http://example.com/FIXME"
:plugins [[lein-localrepo "0.5.3"]]
:license {:name "Eclipse Public License"
:url "http://www.eclipse.org/legal/epl-v10.html"}
:dependencies [[org.clojure/clojure "1.6.0"]
[org.clojure/data.json "0.2.5"]
[quil "2.2.5"]
[unfolding "0.9.6"] ; Installed in local repo
[json4proc "0.9.6"] ; Ditto; shipped with unfolding
[log4j "1.2.15"]])
And, my simple core.clj looks like so:
(ns transit-map.core
(:import (de.fhpotsdam.unfolding UnfoldingMap)
(de.fhpotsdam.unfolding.geo Location)
(de.fhpotsdam.unfolding.providers StamenMapProvider)
(de.fhpotsdam.unfolding.marker SimplePointMarker))
(:require [quil.core :as q]
[quil.middleware :as m]))
(defn setup []
;; Only has close to enough time to plot if the framerate is very
;; low, and even then doesn't quite get the job done.
(q/frame-rate 1)
;; setup function returns initial state.
;; State is one big happy hashmap
{:bg-map (doto (UnfoldingMap.
(quil.applet/current-applet)
(de.fhpotsdam.unfolding.providers.StamenMapProvider$TonerBackground.))
(.setZoomRange 10 12)
(.zoomToLevel 11)
(.panTo (Location. 47.625 -122.332071))
(.draw))})
(defn update-state [state])
(defn draw-state [state]
(.draw (state :bg-map)))
(q/defsketch transit-map
:title "Transit map"
:size [250 500]
;; setup function called only once, during sketch initialization.
:setup setup
;; update-state is called on each iteration before draw-state.
:update update-state
:draw draw-state
;; This sketch uses functional-mode middleware.
:middleware [m/fun-mode])
Remarkably, for very little effort, this works... sort of. Even with the frame rate dialed back to 1fps, the background image isn't quite able to render:
Any suggestions on how to give this particular element the time it needs to render fully? Ultimately, I'm looking to do some animations on top of this at more than 1fps. I'm beginning to suspect that my best bet will be to grab a static image and throw that in the background. But, is there anything else that people can recommend here?

Well, it looks like storing the map context in the state hashmap is the problem. Defining the background map in setup as:
(def bgmap
(doto (UnfoldingMap.
(quil.applet/current-applet)
(de.fhpotsdam.unfolding.providers.StamenMapProvider$TonerBackground.))
(.setZoomRange 10 13)
(.zoomToLevel 12)
(.draw)))
Works if I then call the draw method in draw-state as such:
(.draw bgmap)
I can set the framerate to reasonable levels, and the relatively slow drawing of the background map simply takes a few frames to fully fill in--exactly what I was looking for.

Related

core.async difference between Clojure and ClojureScript [duplicate]

This question already has answers here:
Can't seem to require >!! or <!! in Clojurescript?
(2 answers)
Closed 4 years ago.
I am working on my first ClojureScript project, and I am not able to find core.async functions/macros I am used to in Clojure; like thread, <!!. (I checked the source code in github as well and they do not exist in the cljs source)
Is there some reference I can use to find the differences between the usage of core.async in Clojure and ClojureScript?
Also, how do I perform a blocking get operation from a chan outside a go block in cljs? Looks like cljs does not have any blocking operations in core.async
Or just start a separate thread for a function which is not going to return any value?
Google doesn't really seem to provide a lot of info about core.async in cljs
Any help or pointers would be appreciated!
core.async is a separate library. Make your project.clj look like this:
(defproject flintstones "0.1.0-SNAPSHOT"
:min-lein-version "2.7.1"
:dependencies [[org.clojure/clojure "1.9.0"]
[org.clojure/clojurescript "1.10.238"]
[org.clojure/core.async "0.4.474"]]
...
and your CLJS namespace should define something like:
(ns tst.flintstones.dino
(:require
[cljs.test :refer-macros [deftest is async use-fixtures]]
[cljs.core.async :as async]
[dinoPhony] ))
and code like:
(let [ch (async/chan)]
(async/go (async/>! ch 42))
(println "dino: async result:" (async/go (async/<! ch)))
Please see this template project for a working example.

Clojure JavaFX -- Toolkit Not Initialized error

JavaFX 8, Java 1.8.0_31, Windows 7 x64
I have a minimal JavaFX program in Clojure. The (ns...) clause is able to import the required Java packages fine except the classes in javafx.scene.control, such as Button and TextField, etc.
I have to put the import for these after initializing the toolkit. Why can't I import these classes before the toolkit is initialized? I'm not actually creating any objects yet... so I'm guessing JFX is somehow doing something in the background while these classes are imported, requiring the initialization first. Below is my complete lein project (minimized from the actual application where I saw this problem, and without all the nice macros that clean up the JFX syntax):
File project.clj:
(defproject jfx-so "0.1.0-SNAPSHOT"
:dependencies [[org.clojure/clojure "1.6.0"]]
:main jfx-so.core)
File src/jfx_so/core.clj:
(ns jfx-so.core
(:import [javafx.scene Scene]
[javafx.scene.layout BorderPane]
[javafx.stage Stage]))
(defonce force-toolkit-init (javafx.embed.swing.JFXPanel.))
;; For some reason the following must be imported after initting the toolkit
(import [javafx.scene.control Button])
(defn -main [& args]
(javafx.application.Platform/runLater
#(doto (Stage.)
(.setScene (Scene. (BorderPane. (Button. "Hello"))))
(.show))))
Thanks! :)
I haven't had a problem with this. Perhaps it has to do with your defonce?
I do my imports first. But I do make sure to init the FX-envoronment before instanciating any FX-classes. So after your -main-method I would put:
(defn -main [& args]
;;body here
)
;; initialze the environement
(javafx.embed.swing.JFXPanel.)
;; ensure I can keep reloading and running without restarting JVM every time
(javafx.application.Platform/setImplicitExit false)
;; then
(-main)
Hope this helps.

How to install lamina / aleph to Clojure?

Currently, I use Leiningen 2.1.3 on Java 1.6.0_45
Clojure 1.5.1 connected LightTable IDE 0.4.11
I want to install lamina, but looking at Installation-
[lamina "0.5.0-rc3"]
doesn't make sense to me since I'm fairly new.
Please advice how to install, and some good resource for the library management system.
Thanks!
You just need to add that line to the :dependencies section of your project.clj file so it looks something like this:
...
:dependencies [[org.clojure/clojure "1.5.1"]
[lamina "0.5.0-rc3"]]
...
Then, use it in wherever you need it:
(ns myproj.core
(:require [lamina.core :as lamina]))
This would make it so you call the channel function like this: (lamina/channel 1 2 3)
Or in the repl:
user=> (use 'lamina.core)
nil
user=> (def ch (channel 1 2 3))
#'user/ch
user=> ch
<== [1 2 3 …]

How do I live code in Clojure using Emacs / nrepl / Quil?

I have a fairly standard Quil file that I am editing with Emacs and nrepl.
(defn setup []
(qc/smooth)
(qc/frame-rate 24)
(qc/background 200))
(defn draw []
(draw-world))
(qc/defsketch run
:title "Circles!"
:setup setup
:draw draw
:size [800 600]
:renderer :opengl)
To start with, I use C-c C-l to load the file; this creates a sketch window. I then edit my draw-world function to, say, draw in a different color. My question is:
How do I update the current Quil window with this new function?
*C-x C-e doesn't seem to work.
Try C-M-x (this evals the current top-level form) in the function you want to change or C-c C-k (this evals the current buffer) in the source buffer. Btw, C-x C-e should be working too (it certainly works for me, but I rarely use it). Maybe you're not using nrepl.el's latest version?
I just set up a sample project to handle my workflow for live-coding in Quil. I copied some basics from several places, such as the Quil wiki and forums.
If you look at the basic core.clj file of the project, you'll see it requires separate "draw" and "setup" namespaces:
(ns basic-metronome.core
(:use [basic-metronome.setup :only [HEIGHT WIDTH]])
(:require [basic-metronome.draw :as dynamic-draw]
[basic-metronome.setup :as dynamic-setup]
[quil.core :as qc]))
(defn run-sketch []
(qc/defsketch the-sketch
:title "Hello Metronome"
:setup dynamic-setup/setup
:draw dynamic-draw/draw
:size [WIDTH HEIGHT]))
From:
https://github.com/mudphone/basic_quil_metronome/blob/master/src/basic_metronome/core.clj
In this way, I can re-evaluate C-c C-k the draw.clj file without having to re-evaluate the top-level core namespace (which can cause problems, such as the one you describe where you're seeing a new window).

Compojure development without web server restarts

I've written a small Swing App before in Clojure and now I'd like to create an Ajax-style Web-App. Compojure looks like the best choice right now, so that's what I'm going to try out.
I'd like to have a real tiny edit/try feedback-loop, so I'd prefer not to restart the web server after each small change I do.
What's the best way to accomplish this? By default my Compojure setup (the standard stuff with ant deps/ant with Jetty) doesn't seem to reload any changes I do. I'll have to restart with run-server to see the changes. Because of the Java-heritage and the way the system is started etc. This is probably perfectly normal and the way it should be when I start the system from command-line.
Still, there must be a way to reload stuff dynamically while the server is running. Should I use Compojure from REPL to accomplish my goal? If I should, how do I reload my stuff there?
This is quite an old question, and there have been some recent changes that make this much easier.
There are two main things that you want:
Control should return to the REPL so you can keep interacting with your server. This is accomplished by adding {:join? false} to options when starting the Jetty server.
You'd like to automatically pick up changes in certain namespaces when the files change. This can be done with Ring's "wrap-reload" middleware.
A toy application would look like this:
(ns demo.core
(:use webui.nav
[clojure.java.io]
[compojure core response]
[ring.adapter.jetty :only [run-jetty]]
[ring.util.response]
[ring.middleware file file-info stacktrace reload])
(:require [compojure.route :as route] view)
(:gen-class))
; Some stuff using Fleet omitted.
(defroutes main-routes
(GET "/" [] (view/layout {:body (index-page)})
(route/not-found (file "public/404.html"))
)
(defn app
[]
(-> main-routes
(wrap-reload '(demo.core view))
(wrap-file "public")
(wrap-file-info)
(wrap-stacktrace)))
(defn start-server
[]
(run-jetty (app) {:port 8080 :join? false}))
(defn -main [& args]
(start-server))
The wrap-reload function decorates your app routes with a function that detects changes in the listed namespaces. When processing a request, if those namespaces have changed on disk, they are reloaded before further request processing. (My "view" namespace is dynamically created by Fleet, so this auto-reloads my templates whenever they change, too.)
I added a few other pieces of middleware that I've found consistently useful. wrap-file handles static assets. wrap-file-info sets the MIME type on those static assets. wrap-stacktrace helps in debugging.
From the REPL, you could start this app by using the namespace and calling start-server directly. The :gen-class keyword and -main function mean that the app can also be packaged as an uberjar for startup from outside the REPL, too. (There's a world outside the REPL? Well, some people have asked for it anyway...)
Here's an answer I got from James Reeves in the Compojure Google Group (the answer's here with his permission):
You can reload a namespace in Clojure using the :reload key on the use
or require commands. For example, let's say you have a file "demo.clj" that contains your routes:
(ns demo
(:use compojure))
(defroutes demo-routes
(GET "/"
"Hello World")
(ANY "*"
[404 "Page not found"]))
At the REPL, you can use this file and start a server:
user=> (use 'demo)
nil
user=> (use 'compojure)
nil
user=> (run-server {:port 8080} "/*" (servlet demo-routes))
...
You could also put the run-server command in another clojure file.
However, you don't want to put it in the same file as the stuff you want to reload.
Now make some changes to demo.clj. At the REPL type:
user=> (use 'demo :reload)
nil
And your changes should now show up on http://localhost:8080
I wanted to add an answer, since things have changed a bit since the newest answer and I had spent a bit of time looking for this myself.
Install leiningen (just follow the instructions there)
Create project
lein new compojure compojure-test
Edit the ring section of project.clj
:ring {:handler compojure-test.handler/app
:auto-reload? true
:auto-refresh? true}
Start the server on whatever port you want
lein ring server-headless 8080
Check that the server is running in your browser, the default base route should just say "Hello world". Next, go modify your handler (it's in src/project_name). Change the hello world text, save the file and reload the page in your browser. It should reflect the new text.
Following up on Timothy's link to Jim Downing's setup, I recently posted on a critical addition to that baseline that I found was necessary to enable automatic redeployment of compojure apps during development.
I have a shell script that looks like this:
#!/bin/sh
CLASSPATH=/home/me/install/compojure/compojure.jar
CLASSPATH=$CLASSPATH:/home/me/clojure/clojure.jar
CLASSPATH=$CLASSPATH:/home/me/clojure-contrib/clojure-contrib.jar
CLASSPATH=$CLASSPATH:/home/me/elisp/clojure/swank-clojure
for f in /home/me/install/compojure/deps/*.jar; do
CLASSPATH=$CLASSPATH:$f
done
java -server -cp $CLASSPATH clojure.lang.Repl /home/me/code/web/web.clj
web.clj looks like this
(use '[swank.swank])
(swank.swank/ignore-protocol-version "2009-03-09")
(start-server ".slime-socket" :port 4005 :encoding "utf-8")
Whenever I want to update the server I create an ssh tunnel from my local machine to the remote machine.
Enclojure and Emacs (running SLIME+swank-clojure) can connect to the remote REPL.
This is highly configuration dependent but works for me and I think you can adapt it:
Put compojure.jar and the jars under the compojure/deps directory are in your classpath. I use clojure-contrib/launchers/bash/clj-env-dir to do this, all you need to do is set the directory in CLOJURE_EXT and it will find the jars.
CLOJURE_EXT Colon-delimited list of paths to directories whose top-level
contents are (either directly or as symbolic links) jar
files and/or directories whose paths will be in Clojure's
classpath.
Launch clojure REPL
Paste in hello.clj example from compojure root directory
Check localhost:8080
Re-define the greeter
(defroutes greeter
(GET "/"
(html [:h1 "Goodbye World"])))
Check localhost:8080
There are also methods for attaching a REPL to an existing process, or you could keep a socket REPL embedded in your server or you could even define a POST call that will eval on the fly to allow you to redefine functions from the browser itself! There are lots of ways to approach this.
I'd like to follow up on mtnygard's answer and post the full project.clj file and core.clj file that got the given functionality working. A few modifications were made, and it's more barebones
pre-setup commands
lein new app test-web
cd test-web
mkdir resources
project.clj
(defproject test-web "0.1.0-SNAPSHOT"
:description "FIXME: write description"
:url "http://example.com/FIXME"
:license {:name "Eclipse Public License"
:url "http://www.eclipse.org/legal/epl-v10.html"}
:dependencies [[org.clojure/clojure "1.5.1"]
[compojure "1.1.6"]
[ring "1.2.1"]]
:main ^:skip-aot test-web.core
:target-path "target/%s"
:profiles {:uberjar {:aot :all}})
core.clj
(ns test-web.core
(:use
[clojure.java.io]
[compojure core response]
[ring.adapter.jetty :only [run-jetty]]
[ring.util.response]
[ring.middleware file file-info stacktrace reload])
(:require [compojure.route :as route])
(:gen-class))
(defroutes main-routes
(GET "/" [] "Hello World!!")
(GET "/hello" [] (hello))
(route/not-found "NOT FOUND"))
(def app
(-> main-routes
(wrap-reload '(test-web.core))
(wrap-file "resources")
(wrap-file-info)
(wrap-stacktrace)))
(defn hello []
(str "Hello World!"))
(defn start-server
[]
(run-jetty #'app {:port 8081 :join? false}))
(defn -main [& args]
(start-server))
Pay Attention to the change from (defn app ...) to (def app ...)
This was crucial to getting the jetty server to work correctly
Compojure uses ring internally (by the same author), the ring web server options allow automatic realoading. So two alternatives would be :
lein ring server
lein ring server-headless
lein ring server 4000
lein ring server-headless 4000
Note that :
You need to have a line in your project.clj file that looks like:
:ring {:handler your.app/handler}