Skip to content

metaresolver/pig-udf

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pig UDFs

See source comments for usage.

To setup a development environment:

Install Simple Built Tool (SBT):
---
wget http://typesafe.artifactoryonline.com/typesafe/ivy-releases/org.scala-tools.sbt/sbt-launch/0.11.2/sbt-launch.jar
mv -f sbt-launch.jar ~/bin
cat > ~/bin/sbt << "EOF"
java -Xms512M -Xmx1536M -Xss1M -XX:+CMSClassUnloadingEnabled -XX:MaxPermSize=384M -jar `dirname $0`/sbt-launch.jar "$@"
EOF
chmod u+x ~/bin/sbt
---

Compile: sbt compile
Package to a JAR: sbt assembly
Add ~ to any command to make a task run whenever a source file is changed.

** If there are any dependency errors, try the 'magic fix' of: rm -rf ~/.ivy2
   If the web dependencies get too annoying, we can also just put pig.jar
   in lib/ and be done with it.


About

A Load UDF for loading JSON files with Pig

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 98.4%
  • Scala 1.6%