Files

 master

/

test_file.py

Copy path

Blame

Blame

Latest commit

gumblex

Merge master and jieba3k, make the code Python 2/3 compatible

Feb 10, 2015

22bcf8b · Feb 10, 2015

History

History

20 lines (14 loc) · 348 Bytes

/

test_file.py

Top

File metadata and controls

• Code
• Blame

20 lines (14 loc) · 348 Bytes

Raw

import sys import time sys.path.append("../../") import jieba jieba.enable_parallel() url = sys.argv[1] content = open(url,"rb").read() t1 = time.time() words = "/ ".join(jieba.cut(content)) t2 = time.time() tm_cost = t2-t1 log_f = open("1.log","wb") log_f.write(words.encode('utf-8')) print('speed %s bytes/second' % (len(content)/tm_cost))

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19