matrix - Get words and values Between Parentheses in Scala-Spark -


here data :

doc1: (does,1) (just,-1) (what,0) (was,1) (needed,1) (to,0) (charge,1) (the,0) (macbook,1) doc2: (pro,1) (g4,-1) (13inch,0) (laptop,1) doc3: (only,1) (beef,0) (was,1) (it,0) (no,-1) (longer,0) (lights,-1) (up,0) (the,-1) etc...

and want extract words , values , store them in 2 separated matrices , matrix_1 (docid words) , matrix_2 (docid values) ;

input.txt ========= doc1: (does,1) (just,-1) (what,0) (was,1) (needed,1) (to,0) (charge,1) (the,0) (macbook,1) doc2: (pro,1) (g4,-1) (13inch,0) (laptop,1) doc3: (only,1) (beef,0) (was,1) (it,0) (no,-1) (longer,0) (lights,-1) (up,0) (the,-1) 
val inputtext = sc.textfile("input.txt") var digested = input.map(line => line.split(":"))         .map(row => row(0) -> row(1).trim.split(" "))         .map(row => row._1 -> row._2.map(_.stripprefix("(").stripsuffix(")").trim.split(",")))  var matrix_1 = digested.map(row => row._1 -> row._2.map( => a(0))) var matrix_2 = digested.map(row => row._1 -> row._2.map( => a(1)))

gives:

list(   (doc1 -> does,just,what,was,needed,to,charge,the,macbook),   (doc2 -> pro,g4,13inch,laptop),   (doc3 -> only,beef,was,it,no,longer,lights,up,the) )  list(   (doc1 -> 1,-1,0,1,1,0,1,0,1),    (doc2 -> 1,-1,0,1),    (doc3 -> 1,0,1,0,-1,0,-1,0,-1) )

Comments

Post a Comment

Popular posts from this blog

jquery - How do you format the date used in the popover widget title of FullCalendar? -

Image
in fullcalendar, how format date used in popover widget title when clicking '+n more'? code: <div class="fc-popover fc-more-popover"> <div class="fc-header fc-widget-header"> <span class="fc-close fc-icon fc-icon-x"></span> <span class="fc-title">tuesday, april 7</span> ... </div> ... </div> you use daypopoverformat that. determines date format of title of popover created eventlimitclick option. must date formatting string. default value "dddd, mmmm d" english , "ll" other languages.
Read more

Bubble Sort Manually a Linked List in Java -

Image
this first question here. trying manually sort linked list of integers in java , can not figure out wrong code. suggestions? don't error, still have output unordered. tried few different ways, nothing worked. appreciate if can me that. public class node { int data; node nextnode; public node(int data) { this.data = data; this.nextnode = null; } public int getdata() { return this.data; } } // node class public class datalinkedlist implements datainterface { private node head; private int size; public datalinkedlist(){ this.head = null; this.size = 0; } public void add(int data) { node node = new node(data); if (head == null) { head = node; } else { node currentnode = head; while(currentnode.nextnode != null) { currentnode = currentnode.nextnode; } currentnode.nextnode = node; ...
Read more

asp.net mvc - SSO between MVCForum and Umbraco7 -

i need integrate sso between mvcforum (forum of company) , umbraco7 (manages cms company). however struggling shared authentication work. tried several ways suggested on other threads still not running expected. here did: 1. in mvcforum (forum.mywebsite.com) 1.1. machine key in web.xml: <machinekey validationkey="the same key umbraco7" decryptionkey="the same key umbraco7" validation="sha1" decryption="aes" /> 1.2. authenticate forms in web.xml <forms name="my-sso-auth" protection="all" path="/" timeout="43200" domain="forum.mywebsite.com" loginurl="/members/logon" enablecrossappredirects="true" /> 2. in umbraco7 (news.mywebsite.com) 2.1. machine key in web.xml: <machinekey validationkey="the same key mvcforum" decryptionkey="the same key mvcforum" validation="sha1" decryption="aes" /> 2.2. a...
Read more