spark - sbt build tool


The spark documentation doesn't says (or maybe i missed it) about getting sbt tool if you're trying to build it on Windows. You need this to build, package and run scala code in spark.

This tool can be obtained here. Once you have this installed, you can fire up your command / cygwin command prompt and continue building, packing and running your code by following this guide.

basically it is just running sbt assembly.







Comments

Post a Comment

Popular posts from this blog

The specified initialization vector (IV) does not match the block size for this algorithm

Image
If you're getting  exception when trying to assigned key to a symmetric key and getting error message below :- The specified initialization vector (IV) does not match the block size for this algorithm And your code probably look like something below :- Then you need to go into debug mode and start looking into the supported size for IV as shown in diagram below :- As you can see, IV is 16 bytes, so you need to provide 16 bytes. The same goes for Key field too, if you're adding anything to it. As long as you provide a valid key size, then we're good and you're code will be ready.
Read more