关于linux:SparkSQL极速入门-整合Kudu实现广告业务数据分析

29次阅读

共计 1980 个字符,预计需要花费 5 分钟才能阅读完成。

download:SparkSQL 极速入门 整合 Kudu 实现广告业务数据分析

服务器端代码,server_tcp.py

!/usr/bin/env python

– coding:utf-8 –

执行客户端发送过去的命令,并把执行后果返回给客户端

import socket, traceback, subprocess

host = ”
port = 51888

s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
s.setsockopt(socket.SOL_SOCKET, socket.SO_REUSEADDR, 1)

s.bind((host, port))
s.listen(1)

while 1:

try:
    client_socket, client_addr = s.accept()
except Exception, e:
    traceback.print_exc()
    continue

try:
    print 'From host:', client_socket.getpeername()
    while 1:
        command = client_socket.recv(4096)
        if not len(command):
            break
        print client_socket.getpeername()[0] + ':' + str(command)

        # 执行客户端传递过去的命令
        handler = subprocess.Popen(command, shell=True, stdout=subprocess.PIPE)
        output = handler.stdout.readlines()
        if output is None:
            output = []

        for one_line in output:
            client_socket.sendall(one_line)
            client_socket.sendall("\n")

        client_socket.sendall("ok")


except Exception, e:
    traceback.print_exc()

try:
    client_socket.close()
except Exception, e:
    traceback.print_exc()

2. 客户端代码 client_tcp.py

!/usr/bin/env python

– coding:utf-8 –

给 server 端发送命令

import socket, sys, traceback

host = ‘127.0.0.1’
port = 51888

s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
try:

s.connect((host, port))

except Exception, e:

msg = traceback.format_exc()
print '连贯谬误:', msg

input_command = raw_input(‘Input command:’)
s.send(input_command)

利用 shutdown() 函数使 socket 双向数据传输变为单向数据传输

该参数示意了如何敞开 socket。具体为:0 示意禁止未来读;1 示意禁止未来写;2 示意禁止未来读和写

s.shutdown(1)
print ‘ 发送实现.’
print ‘ 收到内容:\n’
while 1:

buff = s.recv(4096)
if not len(buff):
    break

sys.stdout.write(buff)

3. 启动 server_tcp.py 脚本,开始监听本机 51888 端口;接着启动 client_tcp.py.
(1) 客户端内容:

/usr/bin/python2.7 /home/wuguowei/PycharmProjects/xplan_script/test_process/client_tcp.py
Input command:ls -l
发送实现.
收到内容:

总用量 20

-rw-r–r– 1 root root 744 2 月 10 14:44 client_tcp.py

-rw-r–r– 1 root root 877 2 月 10 14:18 my_sub_process.py

-rw-r–r– 1 root root 1290 2 月 10 14:45 server_tcp.py

-rw-r–r– 1 root root 493 2 月 10 10:43 tcpclient.py

-rw-r–r– 1 root root 1168 2 月 10 11:51 tcpserver.py

ok
Process finished with exit code 0

(2)服务器端信息

/usr/bin/python2.7 /home/wuguowei/PycharmProjects/xplan_script/test_process/server_tcp.py
From host: (‘127.0.0.1’, 46993)
127.0.0.1:ls -l

正文完
 0