Repository navigation
Expand file tree
/
Copy pathextractKeywordsWithCustomaParams.py
More file actions
39 lines (34 loc) · 2.94 KB
/
Copy pathextractKeywordsWithCustomaParams.py
File metadata and controls
39 lines (34 loc) · 2.94 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
import yake
text = "Sources tell us that Google is acquiring Kaggle, a platform that hosts data science and machine learning " \
"competitions. Details about the transaction remain somewhat vague, but given that Google is hosting its Cloud " \
"Next conference in San Francisco this week, the official announcement could come as early as tomorrow. " \
"Reached by phone, Kaggle co-founder CEO Anthony Goldbloom declined to deny that the acquisition is happening. " \
"Google itself declined 'to comment on rumors'. Kaggle, which has about half a million data scientists on its platform, " \
"was founded by Goldbloom and Ben Hamner in 2010. " \
"The service got an early start and even though it has a few competitors like DrivenData, TopCoder and HackerRank, " \
"it has managed to stay well ahead of them by focusing on its specific niche. " \
"The service is basically the de facto home for running data science and machine learning competitions. " \
"With Kaggle, Google is buying one of the largest and most active communities for data scientists - and with that, " \
"it will get increased mindshare in this community, too (though it already has plenty of that thanks to Tensorflow " \
"and other projects). Kaggle has a bit of a history with Google, too, but that's pretty recent. Earlier this month, " \
"Google and Kaggle teamed up to host a $100,000 machine learning competition around classifying YouTube videos. " \
"That competition had some deep integrations with the Google Cloud Platform, too. Our understanding is that Google " \
"will keep the service running - likely under its current name. While the acquisition is probably more about " \
"Kaggle's community than technology, Kaggle did build some interesting tools for hosting its competition " \
"and 'kernels', too. On Kaggle, kernels are basically the source code for analyzing data sets and developers can " \
"share this code on the platform (the company previously called them 'scripts'). " \
"Like similar competition-centric sites, Kaggle also runs a job board, too. It's unclear what Google will do with " \
"that part of the service. According to Crunchbase, Kaggle raised $12.5 million (though PitchBook says it's $12.75) " \
"since its launch in 2010. Investors in Kaggle include Index Ventures, SV Angel, Max Levchin, Naval Ravikant, " \
"Google chief economist Hal Varian, Khosla Ventures and Yuri Milner "
language = "en"
max_ngram_size = 3
deduplication_thresold = 0.9
deduplication_algo = 'seqm'
windowSize = 1
numOfKeywords = 20
custom_kw_extractor = yake.KeywordExtractor(lan=language, n=max_ngram_size, dedupLim=deduplication_thresold, dedupFunc=deduplication_algo, windowsSize=windowSize, top=numOfKeywords, features=None)
keywords = custom_kw_extractor.extract_keywords(text)
# The lower the score, the more relevant the keyword is.
for kw in keywords:
print(kw)