i .net programmer , tasked analyzing data spark , cassandra. looking c# api work spark , found out mobius (as don’t know java). started downloading mobius project, github , per build windows followed steps mentioned , not able work. have following questions regarding it.
1) have datastax enterprise in ubuntu machine cassandra , spark available (standalone). connect .net project spark , process data in cassandra. possible me that? want in debug mode? working using spark-sql comfortable in sql.
2) must install solr , spark in windows machine in order mobius work? able connect cassandra (ubuntu machine) windows spark , mobius?
3) when run the command “sparkclr-submit.cmd debug” value csharpbackendportnumber, getting error “load-spark-env.cmd” missing. can find file , how value csharpbackendportnumber? necessary have spark in windows machine?
using windows client connect yarn-based spark cluster in linux supported/validated scenario mobius. have never tried using windows client mobius standalone linux-based spark cluster. recommend using linux machine mobius client verify basic functionality in mobius first.
mobius not need solr. should able use mobius connect cassandra deployed in os.
load-spark-env.cmd part of spark release. need set spark_home environment variable before running sparkclr-submit.cmd
Comments
Post a Comment