Repository navigation
Expand file tree
/
Copy pathhightlightExtractedKeyword.py
More file actions
42 lines (36 loc) · 3.23 KB
/
Copy pathhightlightExtractedKeyword.py
File metadata and controls
42 lines (36 loc) · 3.23 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
from yake.highlight import TextHighlighter
import yake
# Highlighting feature will tag every keyword in the text with the default tag <kw>.
text = "Sources tell us that Google is acquiring Kaggle, a platform that hosts data science and machine learning " \
"competitions. Details about the transaction remain somewhat vague, but given that Google is hosting its Cloud " \
"Next conference in San Francisco this week, the official announcement could come as early as tomorrow. " \
"Reached by phone, Kaggle co-founder CEO Anthony Goldbloom declined to deny that the acquisition is happening. " \
"Google itself declined 'to comment on rumors'. Kaggle, which has about half a million data scientists on its platform, " \
"was founded by Goldbloom and Ben Hamner in 2010. " \
"The service got an early start and even though it has a few competitors like DrivenData, TopCoder and HackerRank, " \
"it has managed to stay well ahead of them by focusing on its specific niche. " \
"The service is basically the de facto home for running data science and machine learning competitions. " \
"With Kaggle, Google is buying one of the largest and most active communities for data scientists - and with that, " \
"it will get increased mindshare in this community, too (though it already has plenty of that thanks to Tensorflow " \
"and other projects). Kaggle has a bit of a history with Google, too, but that's pretty recent. Earlier this month, " \
"Google and Kaggle teamed up to host a $100,000 machine learning competition around classifying YouTube videos. " \
"That competition had some deep integrations with the Google Cloud Platform, too. Our understanding is that Google " \
"will keep the service running - likely under its current name. While the acquisition is probably more about " \
"Kaggle's community than technology, Kaggle did build some interesting tools for hosting its competition " \
"and 'kernels', too. On Kaggle, kernels are basically the source code for analyzing data sets and developers can " \
"share this code on the platform (the company previously called them 'scripts'). " \
"Like similar competition-centric sites, Kaggle also runs a job board, too. It's unclear what Google will do with " \
"that part of the service. According to Crunchbase, Kaggle raised $12.5 million (though PitchBook says it's $12.75) " \
"since its launch in 2010. Investors in Kaggle include Index Ventures, SV Angel, Max Levchin, Naval Ravikant, " \
"Google chief economist Hal Varian, Khosla Ventures and Yuri Milner "
kw_extractor = yake.KeywordExtractor()
keywords = kw_extractor.extract_keywords(text)
# With Default params
th = TextHighlighter(max_ngram_size=3)
# Custom Highlighting Feature
# Besides tagging a text with the default tag, users can also specify their own custom highlight.
# In the following text, the tag <span class='my_class' > makes use of an hyphotetical
# function my_class whose purpose would be to highlight in white colour or the relevant keywords.
# For custom styling
# th = TextHighlighter(max_ngram_size = 3, highlight_pre = "<span class='my_class' >", highlight_post= "</span>")
print(th.highlight(text, keywords))