Home » Categories

大数据

关于大数据:抖音封禁设备解决方案-抖音设备注册出来不可用解决方案-抖音设备激活

先看看设施注册的包： POST https://log-lq.snssdk.com/service/2/device_register/?device_id=56581003169&is_activated=1&aid=1128&tt_data=a&version_code=12.4.0&app_name=aweme&app_version=12.4.0&vid=84185501-88C0-4E38-BA3D-F3656A073020&device_id=56581003169&channel=App%20Store&mcc_mnc=46001&aid=1128&screen_width=1125&openudid=690af6a89ae78c69306c8a07bca241b840sd156&cdid=AD072FE4-41B7-4890-BEBC-2D57A4F3F253&os_api=18&ac=4G&os_version=12.4&build_number=123011&device_platform=android&iid=3125112636576938&device_type=Huawei%C8600&is_vcd=1 HTTP/1.1Host: log-lq.snssdk.comConnection: keep-aliveContent-Length: 856Accept: application/jsonCookie: odin_tt=458f8eb0d95b7b9adb4b6fc6591918bfb996096967a7aa4305bd81b5150a8199d2e29ed21883cdd7709c5beaa2be3baa; sessionid=66e5128a179ef5f03f5187bae265bf9c; sessionid_ss=ff5128a179ef5f03f5187baecss22; sid_guard=d2da128a179ef5f03f5187bae265bf9c%7C1598662639%7C5183349%7CWed%2C+28-Oct-2020+00%3A46%3A28+GMT; sid_tt=66e5128a179ef5f03f5187bae265bf9c; uid_tt=fsffdc1fa00bb0ddddd400f58d5795df3; uid_tt_ss=232ec1fa00bb0ddddd400f58d5795321; install_id=3125112636576938; ttreq=1$432133fb80de2e267dd1a8478e5394cdd0cd23d1Content-Type: application/octet-stream;tt-data=aX-SS-Cookie: install_id=3125112636576938; ttreq=432133fb80de2e267dd1a8478e5394cdd0cd23d1; sessionid=ff5128a179ef5f03f5187baecss22; sessionid_ss=ff5128a179ef5f03f5187baecss22; sid_guard=ff5128a179ef5f03f5187baecss22%7C1598662639%7C5183349%7CWed%2C+28-Oct-2020+00%3A46%3A28+GMT; sid_tt=ff5128a179ef5f03f5187baecss22; uid_tt=d36ec1fa00bb0ddddd400f58d5795df3; uid_tt_ss=d36ec1fa00bb0ddddd400f58d5795df3; odin_tt=a09d8eb0d95b7b9adb4b6fc6591918bfb996096967a7aa4305bd81b5150a8199d2e29ed21883cdd7709c5beaa2be3baatt-request-time: 15994653422123User-Agent: Aweme 12.3.0 rv:123015 (iPhone; iOS 12.2; zh_CN) Cronetaid: 1128x-Tt-Token: 00632e5128a179ef5f03f5187bae265bf9cdded28ab77be5f36e4259d59aa924b6c7f5284cdd07bf788188bb5185d61c32145sdk-version: 2passport-sdk-version: 5.12.1X-SS-STUB: 34C32EDE4A3C45F55403E5EBD44A321BX-SS-DP: 1128x-tt-trace-id: 00-6123a32f7a09f80897b9fe6e7cc5490468-62a08f7a09f32457-01Accept-Encoding: gzip, deflate, brX-Khronos: 1599465342X-Gorgon: 040802f0000e09020319e1d6be6194bfbd32024c25831c86bce在新版设施注册的url中你会发现多了一部分参数，然而有一个参数比拟夺目那就是is_activated=1。明白人一眼就能看进去是什么含意，对于设施注册外面的参数在这里不不便剖析，须要具体理解的能够分割我！评论区有联系方式！首先咱们要晓得抖音封禁设施靠判断什么而后咱们就能够针对它来解。抖音判断一台设施无非就是依据手机的IMEI,IMSI,MAC,零碎版本型号之类的来判断时候同一台设施咱们利用JADX来逆向，要害函数在ttEncrypt办法 func IIDEncrypt(plainStr []byte) []byte { CplainStr := C.CString(string(plainStr)) defer C.free(unsafe.Pointer(CplainStr)) plainlength := len(plainStr) libPathC := C.CString(EXTENSION_DIR + OIDB_API) defer C.free(unsafe.Pointer(libPathC)) encryptedLength := plainlength + 4 + (16 - plainlength%16) CKeyStr := C.CString("!*ss!_defaul%t54K&EY") defer C.free(unsafe.Pointer(CKeyStr)) CEncryptedStr := C.encode(libPathC, CplainStr, C.int(encryptedLength), CKeyStr, C.int(20)) defer C.free(unsafe.Pointer(CEncryptedStr)) encryptedStr := C.GoBytes(unsafe.Pointer(CEncryptedStr), C.int(encryptedLength)) //encryptedHexStr := hex.EncodeToString(encryptedStr) return encryptedStr}char* Encode(char* plain, int plainlength, char* key, int keylength){ //string plain = hexToStr(hexplain); char *xkey; char *xplain; //int keylength = key.length(); //int plainlength = plain.length(); xkey = (char*) malloc(keylength); xplain = (char*) malloc(plainlength); memcpy(xkey, key, keylength); memcpy(xplain, plain, plainlength); unsigned char *out = (unsigned char*) malloc(plainlength + 100); aweme_aes((__int64)xplain, plainlength, (__int64)xkey, keylength, (__int64)out); free(xkey); free(xplain); xkey = NULL; xplain = NULL;// int cryptedStr_length = plainlength + 4 + (16 - plainlength%16);// std::string hexStr = charsToHex(out, cryptedStr_length);// free(out); //out = NULL; return (char*)out;}#include "subs.h" uint32 bswap32(uint32 x){ return ((x << 24) & 0xff000000) | ((x << 8) & 0x00ff0000) | ((x >> 8) & 0x0000ff00) | ((x >> 24) & 0x000000ff);}unsigned char InvSbox[256] = { // inverse s-box 0x52, 0x09, 0x6a, 0xd5, 0x30, 0x36, 0xa5, 0x38, 0xbf, 0x40, 0xa3, 0x9e, 0x81, 0xf3, 0xd7, 0xfb, 0x7c, 0xe3, 0x39, 0x82, 0x9b, 0x2f, 0xff, 0x87, 0x34, 0x8e, 0x43, 0x44, 0xc4, 0xde, 0xe9, 0xcb, 0x54, 0x7b, 0x94, 0x32, 0xa6, 0xc2, 0x23, 0x3d, 0xee, 0x4c, 0x95, 0x0b, 0x42, 0xfa, 0xc3, 0x4e, 0x08, 0x2e, 0xa1, 0x66, 0x28, 0xd9, 0x24, 0xb2, 0x76, 0x5b, 0xa2, 0x49, 0x6d, 0x8b, 0xd1, 0x25, 0x72, 0xf8, 0xf6, 0x64, 0x86, 0x68, 0x98, 0x16, 0xd4, 0xa4, 0x5c, 0xcc, 0x5d, 0x65, 0xb6, 0x92, 0x6c, 0x70, 0x48, 0x50, 0xfd, 0xed, 0xb9, 0xda, 0x5e, 0x15, 0x46, 0x57, 0xa7, 0x8d, 0x9d, 0x84, 0x90, 0xd8, 0xab, 0x00, 0x8c, 0xbc, 0xd3, 0x0a, 0xf7, 0xe4, 0x58, 0x05, 0xb8, 0xb3, 0x45, 0x06, 0xd0, 0x2c, 0x1e, 0x8f, 0xca, 0x3f, 0x0f, 0x02, 0xc1, 0xaf, 0xbd, 0x03, 0x01, 0x13, 0x8a, 0x6b, 0x3a, 0x91, 0x11, 0x41, 0x4f, 0x67, 0xdc, 0xea, 0x97, 0xf2, 0xcf, 0xce, 0xf0, 0xb4, 0xe6, 0x73, 0x96, 0xac, 0x74, 0x22, 0xe7, 0xad, 0x35, 0x85, 0xe2, 0xf9, 0x37, 0xe8, 0x1c, 0x75, 0xdf, 0x6e, 0x47, 0xf1, 0x1a, 0x71, 0x1d, 0x29, 0xc5, 0x89, 0x6f, 0xb7, 0x62, 0x0e, 0xaa, 0x18, 0xbe, 0x1b, 0xfc, 0x56, 0x3e, 0x4b, 0xc6, 0xd2, 0x79, 0x20, 0x9a, 0xdb, 0xc0, 0xfe, 0x78, 0xcd, 0x5a, 0xf4, 0x1f, 0xdd, 0xa8, 0x33, 0x88, 0x07, 0xc7, 0x31, 0xb1, 0x12, 0x10, 0x59, 0x27, 0x80, 0xec, 0x5f, 0x60, 0x51, 0x7f, 0xa9, 0x19, 0xb5, 0x4a, 0x0d, 0x2d, 0xe5, 0x7a, 0x9f, 0x93, 0xc9, 0x9c, 0xef, 0xa0, 0xe0, 0x3b, 0x4d, 0xae, 0x2a, 0xf5, 0xb0, 0xc8, 0xeb, 0xbb, 0x3c, 0x83, 0x53, 0x99, 0x61, 0x17, 0x2b, 0x04, 0x7e, 0xba, 0x77, 0xd6, 0x26, 0xe1, 0x69, 0x14, 0x63, 0x55, 0x21, 0x0c, 0x7d }; unsigned char Sbox[256] = { // forward s-box 0x63, 0x7c, 0x77, 0x7b, 0xf2, 0x6b, 0x6f, 0xc5, 0x30, 0x01, 0x67, 0x2b, 0xfe, 0xd7, 0xab, 0x76, 0xca, 0x82, 0xc9, 0x7d, 0xfa, 0x59, 0x47, 0xf0, 0xad, 0xd4, 0xa2, 0xaf, 0x9c, 0xa4, 0x72, 0xc0, 0xb7, 0xfd, 0x93, 0x26, 0x36, 0x3f, 0xf7, 0xcc, 0x34, 0xa5, 0xe5, 0xf1, 0x71, 0xd8, 0x31, 0x15, 0x04, 0xc7, 0x23, 0xc3, 0x18, 0x96, 0x05, 0x9a, 0x07, 0x12, 0x80, 0xe2, 0xeb, 0x27, 0xb2, 0x75, 0x09, 0x83, 0x2c, 0x1a, 0x1b, 0x6e, 0x5a, 0xa0, 0x52, 0x3b, 0xd6, 0xb3, 0x29, 0xe3, 0x2f, 0x84, 0x53, 0xd1, 0x00, 0xed, 0x20, 0xfc, 0xb1, 0x5b, 0x6a, 0xcb, 0xbe, 0x39, 0x4a, 0x4c, 0x58, 0xcf, 0xd0, 0xef, 0xaa, 0xfb, 0x43, 0x4d, 0x33, 0x85, 0x45, 0xf9, 0x02, 0x7f, 0x50, 0x3c, 0x9f, 0xa8, 0x51, 0xa3, 0x40, 0x8f, 0x92, 0x9d, 0x38, 0xf5, 0xbc, 0xb6, 0xda, 0x21, 0x10, 0xff, 0xf3, 0xd2, 0xcd, 0x0c, 0x13, 0xec, 0x5f, 0x97, 0x44, 0x17, 0xc4, 0xa7, 0x7e, 0x3d, 0x64, 0x5d, 0x19, 0x73, 0x60, 0x81, 0x4f, 0xdc, 0x22, 0x2a, 0x90, 0x88, 0x46, 0xee, 0xb8, 0x14, 0xde, 0x5e, 0x0b, 0xdb, 0xe0, 0x32, 0x3a, 0x0a, 0x49, 0x06, 0x24, 0x5c, 0xc2, 0xd3, 0xac, 0x62, 0x91, 0x95, 0xe4, 0x79, 0xe7, 0xc8, 0x37, 0x6d, 0x8d, 0xd5, 0x4e, 0xa9, 0x6c, 0x56, 0xf4, 0xea, 0x65, 0x7a, 0xae, 0x08, 0xba, 0x78, 0x25, 0x2e, 0x1c, 0xa6, 0xb4, 0xc6, 0xe8, 0xdd, 0x74, 0x1f, 0x4b, 0xbd, 0x8b, 0x8a, 0x70, 0x3e, 0xb5, 0x66, 0x48, 0x03, 0xf6, 0x0e, 0x61, 0x35, 0x57, 0xb9, 0x86, 0xc1, 0x1d, 0x9e, 0xe1, 0xf8, 0x98, 0x11, 0x69, 0xd9, 0x8e, 0x94, 0x9b, 0x1e, 0x87, 0xe9, 0xce, 0x55, 0x28, 0xdf, 0x8c, 0xa1, 0x89, 0x0d, 0xbf, 0xe6, 0x42, 0x68, 0x41, 0x99, 0x2d, 0x0f, 0xb0, 0x54, 0xbb, 0x16 }; __int64 aweme_aes(__int64 plainStr, __int64 plainStr_length, __int64 key, __int64 key_length, __int64 strOut){ return sub_1005D099C((const void *)plainStr, plainStr_length, (void *)key, key_length, (_BYTE *)strOut, 2);} signed __int64 sub_1005D099C(const void *plainStr, signed int plainStr_length, void *keyStr, signed int keyStr_Length, _BYTE *strOut, char value_2){ char v6; // w21 _BYTE *strOut2; // x19 signed int v8; // w20 const void *v9; // x22 signed __int64 result; // x0 int v11; // w8 unsigned int v12; // w8 int v13; // w9 int v14; // w8 unsigned int v15; // w24 int v16; // w25 _BYTE *v17; // x23 signed __int64 v18; // x8 signed __int64 v19; // x8 int v20; // w10 int w11; // w11 int w12; // w12 int w14; // w14 unsigned int *v24; // x13 unsigned int v25; // w16 unsigned int *v26; // [xsp+8h] [xbp-58h] int v27; // [xsp+Ch] [xbp-54h] int v28; // [xsp+10h] [xbp-50h] int v29; // [xsp+14h] [xbp-4Ch] v26 = (unsigned int*) malloc(1000); v6 = value_2; strOut2 = strOut; v8 = plainStr_length; v9 = plainStr; result = 0xFFFFFFFFLL; if (keyStr_Length >= 1 && keyStr && plainStr_length >= 1 && strOut) { sub_1005D0B50(keyStr, keyStr_Length, (unsigned int *)v26); //sub_1005D0B50(a3, a4, (unsigned int *)&v26); v11 = v8 + 15; if (v8 >= 0) v11 = v8; v12 = v8 - (v11 & 0xFFFFFFF0); v13 = 16 - v12; v14 = 31 - v12; if (v13 >= 0) v14 = v13; v15 = v13 - (v14 & 0xFFFFFFF0); v16 = v8 + v15 + 4; v17 = strOut2 + 4; memmove(strOut2 + 4, v9, v8); *strOut2 = 116; strOut2[1] = 99; strOut2[2] = v6; strOut2[3] = v15; if (v16 >= 5) //plainStr_length { v18 = (unsigned int)v16 - 4LL; do { *v17 = Sbox[(unsigned __int8)*v17]; ++v17; --v18; } while (v18); } if ((signed int)(v15 + v8) >= 16) { v19 = 0LL;// v20 = v26; //0x25//// w11 = (int)((&v26)[1]);// w12 = (int)((&v26)[2]);// w14 = (int)((&v26)[3]); v20 = *v26; //0x25 //int * tmp1 = (int*)v20; w11 = v26[1]; // int * tmp2 = (int*)w11; w12 = v26[2]; //int * tmp3 = (int*)w12; w14 = v26[3]; //int * tmp4 = (int*)w14; v24 = (unsigned int *)(strOut2 + 16); do { v25 = *(v24 - 2); *(v24 - 3) = bswap32(bswap32(*(v24 - 3)) ^ v20); *(v24 - 2) = bswap32(w11 ^ __ROR4__(bswap32(v25), 24)); *(v24 - 1) = bswap32(w12 ^ __ROR4__(bswap32(*(v24 - 1)), 16)); *v24 = bswap32(w14 ^ __ROR4__(bswap32(*v24), 8)); v24 += 4; ++v19; } while (v19 < (v15 + v8) >> 4); } result = 0LL; } free(v26); v26 = NULL; return result;} void * sub_1005D0B50(void *keyStr, signed int keyStr_length, unsigned int *out){ unsigned int *out2; // x19 signed int keyStr_length2; // w20 signed int v5; // w21 void *result; // x0 __int64 v7; // x8 bool v8; // nf unsigned __int8 v9; // vf __int64 v10; // x8 unsigned int v11; // w9 unsigned int v12; // w9 out2 = out; keyStr_length2 = keyStr_length; if (keyStr_length >= 16) v5 = 16; else v5 = keyStr_length; result = memcpy(out, keyStr, v5); if (keyStr_length2 <= 15) { v7 = v5 + 1; do { *((_BYTE *)out2 + v7 - 1) = InvSbox[*((unsigned __int8 *)out2 + v7 - 2)]; v9 = __OFSUB__(v7, 16LL); v8 = v7++ - 16 < 0; } while (v8 ^ v9); } v10 = 0LL; do { *((_BYTE *)out2 + v10) = Sbox[*((unsigned __int8 *)out2 + v10)]; ++v10; } while (v10 != 16); v11 = out2[1]; *out2 = bswap32(*out2); //w10 out2[1] = bswap32(v11); //w11 v12 = out2[3]; out2[2] = bswap32(out2[2]); //w12 out2[3] = bswap32(v12); //w14 //printf(""); return result;}通过下面device_register的url咱们能够晓得，设施注册其实是向抖音提交以后设施的一些信息，例如MAC、SSID、UUID、IMEI、IMSI、WIFIMAC、device_brand、device_model、device_board、device_type、openudid、clientudid、build_serial等等来注册失去 device_id和install_id。 其实抖音的验签机制很野，即便你的x-gorgon算法生成略微和它APP自身计算的有些出入（说白了就是抖音检测到你是独立计算到），它照样会凋谢一些性能给你，比方获取feed接口（热门视频），然而你会发现没法点赞，评论，私信。起初通过frida进行一个hook验证，发现确有此事，很多x-gorgon算法都是应用hook或者间接调用so到形式实现到，基本没去真正解刨它外面到运算过程。再一次测试到过程中，我把url以及x-khrons和cookie，xttsub固定起来，应用hook或者调用so的形式去计算x-gorgon后果，发现不论你执行多少次，后果都是一样的。然而，我应用frida来拦挡抖音它本人的签名过程，并把参数改成和下面的一样，那么它每次计算的后果都不一样。由此可见，抖音在计算过程中必定获取了某些全局参数，比方它签名后会把一些值存入到一个全局变量，下次计算到时候读取，也或者它在某些性能动作到时候，会记录一些值，影响签名到计算算法。这个事件到的确失去屡次证实，用hook或者so调用形式其实抖音是晓得的如果是间接把SO拿进去调用，失去的跟APP外面得出的是不统一的。进一步验证，我把cms的接口都HOOK住。而后看程序。输入后果如下 ...

November 30, 2020 · 7 min · jiezi

关于大数据:浅谈安卓逆向协议-抖音皮皮虾

抖音和皮皮虾同出师门，所以这里以抖音为主，其实是一样的办法。抖音安卓协定以后分为两个版本老版本as cp mas和新版本as cp mas X-Gorgon ，咱们浅谈第一个版本，其实第二个版本如果你把握了逆向操作，一样能抠出来，对于我来说老版本刚刚好够用，过一阵子可能要弄新版本。jdax搜寻"as="通过代码能够发现，他们是通过native层 UserInfo.getUserInfo这个native层函数获取到userInfo，而后计算出as、mas、cp抖音走过的坑，我之前狐疑libcms.so是不是这个 native 层 getUserInfo所在的so，始终无奈确定。最初理解到它是onload，动静RegisterNatives。通过inline_hook，确定了它的基址。当然在getUserInfo之前，还调用了两个初始化native层函数setAppId和initUser。具体能够HOOK看到赋值。 抖音native我没跟进去，因为感觉没必要，我刚好够用。最初拿到签名的形式有很多例如，1：xposed的hook，2：嵌入SO调用native层函数，3：unicorn模仿arm中调用函数，4:Ida pro 逆向汇编翻译成C++等。 TiToData：业余的短视频数据接口服务平台。更多信息请分割： TiToData笼罩支流平台：抖音，快手，小红书，TikTok，Zynn，YouTube，1688，拼多多，淘宝，美团，饿了么，淘宝，微博

November 30, 2020 · 1 min · jiezi

关于大数据:抖音推荐算法原理全文详解

抖音举荐算法原理全文详解本次分享将次要介绍今日头条举荐零碎概览以及内容分析、用户标签、评估剖析，内容平安等原理。 一、零碎概览举荐零碎，如果用形式化的形式去形容实际上是拟合一个用户对内容满意度的函数，这个函数须要输出三个维度的变量。   第一个维度是内容。头条当初曾经是一个综合内容平台，图文、视频、UGC小视频、问答、微头条，每种内容有很多本人的特色，须要思考怎么提取不同内容类型的特色做好举荐。第二个维度是用户特色。包含各种趣味标签，职业、年龄、性别等，还有很多模型刻划出的隐式用户趣味等。第三个维度是环境特色。这是挪动互联网时代举荐的特点，用户随时随地挪动，在工作场合、通勤、游览等不同的场景，信息偏好有所偏移。联合三方面的维度，模型会给出一个预估，即揣测举荐内容在这一场景下对这一用户是否适合。这里还有一个问题，如何引入无奈间接掂量的指标？举荐模型中，点击率、浏览工夫、点赞、评论、转发包含点赞都是能够量化的指标，可能用模型间接拟合做预估，看线上晋升状况能够晓得做的好不好。但一个大体量的举荐零碎，服务用户泛滥，不能齐全由指标评估，引入数据指标以外的因素也很重要。比方广告和特型内容频控。像问答卡片就是比拟非凡的内容模式，其举荐的指标不齐全是让用户浏览，还要思考吸引用户答复为社区奉献内容。这些内容和一般内容如何混排，怎么管制频控都须要思考。此外，平台出于内容生态和社会责任的考量，像低俗内容的打压，题目党、低质内容的打压，重要新闻的置顶、加权、强插，低级别账号内容降权都是算法自身无奈实现，须要进一步对内容进行干涉。上面我将简略介绍在上述算法指标的根底上如何对其实现。后面提到的公式y = F(Xi ,Xu ,Xc)，是一个很经典的监督学习问题。可实现的办法有很多，比方传统的协同过滤模型，监督学习算法Logistic Regression模型，基于深度学习的模型，Factorization Machine和GBDT等。一个优良的工业级举荐零碎须要非常灵活的算法试验平台，能够反对多种算法组合，包含模型结构调整。因为很难有一套通用的模型架构实用于所有的举荐场景。当初很风行将LR和DNN联合，前几年Facebook也将LR和GBDT算法做联合。今日头条旗下几款产品都在沿用同一套弱小的算法举荐零碎，但依据业务场景不同，模型架构会有所调整。模型之后再看一下典型的举荐特色，次要有四类特色会对举荐起到比拟重要的作用。第一类是相关性特色，就是评估内容的属性和与用户是否匹配。显性的匹配包含关键词匹配、分类匹配、起源匹配、主题匹配等。像FM模型中也有一些隐性匹配，从用户向量与内容向量的间隔能够得出。第二类是环境特色，包含地理位置、工夫。这些既是bias特色，也能以此构建一些匹配特色。第三类是热度特色。包含全局热度、分类热度，主题热度，以及关键词热度等。内容热度信息在大的举荐零碎特地在用户冷启动的时候十分无效。第四类是协同特色，它能够在局部水平上帮忙解决所谓算法越推越窄的问题。协同特色并非思考用户已有历史。而是通过用户行为剖析不同用户间相似性，比方点击类似、趣味分类类似、主题类似、趣味词类似，甚至向量类似，从而扩大模型的摸索能力。模型的训练上，头条系大部分举荐产品采纳实时训练。实时训练省资源并且反馈快，这对信息流产品十分重要。用户须要行为信息能够被模型疾速捕获并反馈至下一刷的举荐成果。咱们线上目前基于storm集群实时处理样本数据，包含点击、展示、珍藏、分享等动作类型。模型参数服务器是外部开发的一套高性能的零碎，因为头条数据规模增长太快，相似的开源零碎稳定性和性能无奈满足，而咱们自研的零碎底层做了很多针对性的优化，提供了欠缺运维工具，更适配现有的业务场景。目前，头条的举荐算法模型在世界范畴内也是比拟大的，蕴含几百亿原始特色和数十亿向量特色。整体的训练过程是线上服务器记录实时特色，导入到Kafka文件队列中，而后进一步导入Storm集群生产Kafka数据，客户端回传举荐的label结构训练样本，随后依据最新样本进行在线训练更新模型参数，最终线上模型失去更新。这个过程中次要的提早在用户的动作反馈延时，因为文章举荐后用户不肯定马上看，不思考这部分工夫，整个零碎是简直实时的。但因为头条目前的内容量十分大，加上小视频内容有千万级别，举荐零碎不可能所有内容全副由模型预估。所以须要设计一些召回策略，每次举荐时从海量内容中筛选出千级别的内容库。召回策略最重要的要求是性能要极致，个别超时不能超过50毫秒。   召回策略品种有很多，咱们次要用的是倒排的思路。离线保护一个倒排，这个倒排的key能够是分类，topic，实体，起源等。排序思考热度、新鲜度、动作等。线上召回能够迅速从倒排中依据用户趣味标签对内容做截断，高效的从很大的内容库中筛选比拟靠谱的一小部分内容。 二、内容分析内容分析包含文本剖析，图片剖析和视频剖析。头条一开始次要做资讯，明天咱们次要讲一下文本剖析。文本剖析在举荐零碎中一个很重要的作用是用户趣味建模。没有内容及文本标签，无奈失去用户趣味标签。举个例子，只有晓得文章标签是互联网，用户看了互联网标签的文章，能力晓得用户有互联网标签，其余关键词也一样。 另一方面，文本内容的标签能够间接帮忙举荐特色，比方魅族的内容能够举荐给关注魅族的用户，这是用户标签的匹配。如果某段时间举荐主频道成果不现实，呈现举荐窄化，用户会发现到具体的频道举荐（如科技、体育、娱乐、军事等）中浏览后，再回主feed,举荐成果会更好。因为整个模型是买通的，子频道摸索空间较小，更容易满足用户需要。只通过繁多信道反馈进步举荐准确率难度会比拟大，子频道做的好很重要。而这也须要好的内容分析。上图是今日头条的一个理论文本case。能够看到，这篇文章有分类、关键词、topic、实体词等文本特色。当然不是没有文本特色，举荐零碎就不能工作，举荐零碎最晚期利用在Amazon,甚至沃尔玛时代就有，包含Netfilx做视频举荐也没有文本特色间接协同过滤举荐。但对资讯类产品而言，大部分是生产当天内容，没有文本特色新内容冷启动十分艰难，协同类特色无奈解决文章冷启动问题。今日头条举荐零碎次要抽取的文本特色包含以下几类。首先是语义标签类特色，显式为文章打上语义标签。这部分标签是由人定义的特色，每个标签有明确的意义，标签体系是预约义的。此外还有隐式语义特色，次要是topic特色和关键词特色，其中topic特色是对于词概率分布的形容，无明确意义；而关键词特色会基于一些对立特征描述，无明确汇合。另外文本类似度特色也十分重要。在头条，已经用户反馈最大的问题之一就是为什么总举荐反复的内容。这个问题的难点在于，每个人对反复的定义不一样。举个例子，有人感觉这篇讲皇马和巴萨的文章，昨天曾经看过相似内容，明天还说这两个队那就是反复。但对于一个重度球迷而言，尤其是巴萨的球迷，巴不得所有报道都看一遍。解决这一问题须要依据判断类似文章的主题、行文、主体等内容，依据这些特色做线上策略。同样，还有时空特色，剖析内容的产生地点以及时效性。比方武汉限行的事件推给北京用户可能就没有意义。最初还要思考品质相干特色，判断内容是否低俗，色情，是否是软文，鸡汤？上图是头条语义标签的特色和应用场景。他们之间层级不同，要求不同。分类的指标是笼罩全面，心愿每篇内容每段视频都有分类；而实体体系要求精准，雷同名字或内容要能明确辨别到底指代哪一个人或物，但不必笼罩很全。概念体系则负责解决比拟准确又属于抽象概念的语义。这是咱们最后的分类，实际中发现分类和概念在技术上能互用，起初对立用了一套技术架构。目前，隐式语义特色曾经能够很好的帮忙举荐，而语义标签须要继续标注，新名词新概念一直呈现，标注也要一直迭代。其做好的难度和资源投入要远大于隐式语义特色，那为什么还须要语义标签？有一些产品上的须要，比方频道须要有明确定义的分类内容和容易了解的文本标签体系。语义标签的成果是查看一个公司NLP技术水平的试金石。今日头条举荐零碎的线上分类采纳典型的层次化文本分类算法。最下面Root，上面第一层的分类是像科技、体育、财经、娱乐，体育这样的大类，再上面细分足球、篮球、乒乓球、网球、田径、游泳…，足球再细分国际足球、中国足球，中国足球又细分中甲、中超、国家队…，相比独自的分类器，利用层次化文本分类算法能更好地解决数据歪斜的问题。有一些例外是，如果要进步召回，能够看到咱们连贯了一些飞线。这套架构通用，但依据不同的问题难度，每个元分类器能够异构，像有些分类SVM成果很好，有些要联合CNN，有些要联合RNN再解决一下。上图是一个实体词辨认算法的case。基于分词后果和词性标注选取候选，期间可能须要依据知识库做一些拼接，有些实体是几个词的组合，要确定哪几个词联合在一起能映射实体的形容。如果后果映射多个实体还要通过词向量、topic散布甚至词频自身等去歧，最初计算一个相关性模型。 三、用户标签内容分析和用户标签是举荐零碎的两大基石。内容分析波及到机器学习的内容多一些，相比而言，用户标签工程挑战更大。今日头条罕用的用户标签包含用户感兴趣的类别和主题、关键词、起源、基于趣味的用户聚类以及各种垂直趣味特色（车型，体育球队，股票等）。还有性别、年龄、地点等信息。性别信息通过用户第三方社交账号登录失去。年龄信息通常由模型预测，通过机型、浏览工夫散布等预估。常驻地点来自用户受权拜访地位信息，在地位信息的根底上通过传统聚类的办法拿到常驻点。常驻点联合其余信息，能够揣测用户的工作地点、出差地点、游览地点。这些用户标签十分有助于举荐。当然最简略的用户标签是浏览过的内容标签。但这里波及到一些数据处理策略。次要包含：一、过滤噪声。通过停留时间短的点击，过滤题目党。二、热点惩办。对用户在一些热门文章（如前段时间PG One的新闻）上的动作做降权解决。实践上，流传范畴较大的内容，置信度会降落。三、工夫衰减。用户趣味会产生偏移，因而策略更偏差新的用户行为。因而，随着用户动作的减少，老的特色权重会随工夫衰减，新动作奉献的特色权重会更大。四、惩办展示。如果一篇举荐给用户的文章没有被点击，相干特色（类别，关键词，起源）权重会被惩办。当然同时，也要思考全局背景，是不是相干内容推送比拟多，以及相干的敞开和dislike信号等。用户标签开掘总体比较简单，次要还是刚刚提到的工程挑战。头条用户标签第一版是批量计算框架，流程比较简单，每天抽取昨天的日活用户过来两个月的动作数据，在Hadoop集群上批量计算结果。但问题在于，随着用户高速增长，趣味模型品种和其余批量解决工作都在减少，波及到的计算量太大。2014年，批量解决工作几百万用户标签更新的Hadoop工作，当天实现曾经开始勉强。集群计算资源缓和很容易影响其它工作，集中写入分布式存储系统的压力也开始增大，并且用户趣味标签更新提早越来越高。    面对这些挑战。2014年底今日头条上线了用户标签Storm集群流式计算零碎。改成流式之后，只有有用户动作更新就更新标签，CPU代价比拟小，能够节俭80%的CPU工夫，大大降低了计算资源开销。同时，只需几十台机器就能够撑持每天数千万用户的趣味模型更新，并且特色更新速度十分快，根本能够做到准实时。这套零碎从上线始终应用至今。当然，咱们也发现并非所有用户标签都须要流式零碎。像用户的性别、年龄、常驻地点这些信息，不须要实时反复计算，就依然保留daily更新。 四、评估剖析下面介绍了举荐零碎的整体架构，那么如何评估举荐成果好不好？有一句我认为十分有智慧的话，“一个事件没法评估就没法优化”。对举荐零碎也是一样。事实上，很多因素都会影响举荐成果。比方侯选汇合变动，召回模块的改良或减少，举荐特色的减少，模型架构的改良在，算法参数的优化等等，不一一举例。评估的意义就在于，很多优化最终可能是负向成果，并不是优化上线后成果就会改良。全面的评估举荐零碎，须要齐备的评估体系、弱小的试验平台以及易用的教训剖析工具。所谓齐备的体系就是并非繁多指标掂量，不能只看点击率或者停留时长等，须要综合评估。很多公司算法做的不好，并非是工程师能力不够，而是须要一个弱小的试验平台，还有便捷的试验剖析工具，能够智能剖析数据指标的置信度。一个良好的评估体系建设须要遵循几个准则，首先是兼顾短期指标与长期指标。我在之前公司负责电商方向的时候察看到，很多策略调整短期内用户感觉陈腐，然而长期看其实没有任何助益。其次，要兼顾用户指标和生态指标。既要为内容创作者提供价值，让他更有尊严的创作，也有任务满足用户，这两者要均衡。还有广告主利益也要思考，这是多方博弈和均衡的过程。另外，要留神协同效应的影响。试验中严格的流量隔离很难做到，要留神内部效应。 弱小的试验平台十分间接的长处是，当同时在线的试验比拟多时，能够由平台主动调配流量，无需人工沟通，并且试验完结流量立刻回收，进步管理效率。这能帮忙公司升高剖析老本，放慢算法迭代效应，使整个零碎的算法优化工作可能疾速往前推动。这是头条A/B Test试验零碎的基本原理。首先咱们会做在离线状态下做好用户分桶，而后线上调配试验流量，将桶里用户打上标签，分给实验组。举个例子，开一个10%流量的试验，两个实验组各5%，一个5%是基线，策略和线上大盘一样，另外一个是新的策略。试验过程中用户动作会被收集，基本上是准实时，每小时都能够看到。但因为小时数据有稳定，通常是以天为工夫节点来看。动作收集后会有日志解决、分布式统计、写入数据库，十分便捷。在这个零碎下工程师只须要设置流量需要、试验工夫、定义非凡过滤条件，自定义实验组ID。零碎能够主动生成：试验数据比照、试验数据置信度、试验论断总结以及试验优化倡议。当然，只有试验平台是远远不够的。线上试验平台只能通过数据指标变动揣测用户体验的变动，但数据指标和用户体验存在差别，很多指标不能齐全量化。很多改良依然要通过人工剖析，重大改良须要人工评估二次确认。 五、内容平安最初要介绍今日头条在内容平安上的一些动作。头条当初曾经是国内最大的内容创作与散发凭条，必须越来越器重社会责任和行业领导者的责任。如果1%的举荐内容呈现问题，就会产生较大的影响。今日头条的内容次要来源于两局部，一是具备成熟内容生产能力的PGC平台一是UGC用户内容，如问答、用户评论、微头条。这两局部内容须要通过对立的审核机制。如果是数量绝对少的PGC内容，会间接进行危险审核，没有问题会大范畴举荐。UGC内容须要通过一个危险模型的过滤，有问题的会进入二次危险审核。审核通过后，内容会被真正进行举荐。这时如果收到一定量以上的评论或者举报负向反馈，还会再回到复审环节，有问题间接下架。   TiToData：业余的短视频数据接口服务平台。 更多信息请分割： TiToData笼罩支流平台：抖音，快手，小红书，TikTok，Zynn，YouTube，1688，拼多多，淘宝，美团，饿了么，淘宝，微博

November 29, 2020 · 1 min · jiezi

关于大数据:Data-Lakehouse-湖仓一体-到底是什么

本文转载自 https://mp.weixin.qq.com/s/Il... 背景数据湖（Data Lake)，湖仓一体（Data Lakehouse）俨然曾经成为了大数据畛域最为炽热的风行词，在承受这些风行词洗礼的时候，身为技术人员咱们往往会收回这样的疑难，这是一种新的技术吗，还是仅仅只是概念上的翻新（新瓶装旧酒）呢？它到底解决了什么问题，领有什么样新的个性呢？它的现状是什么，还存在什么问题呢？ 带着这些问题，明天就从笔者的了解，为大家揭开Data Lakehouse的神秘面纱，来探一探起技术的实质到底是什么？ Data Lakehouse（湖仓一体）是新呈现的一种数据架构，它同时排汇了数据仓库和数据湖的劣势，数据分析师和数据科学家能够在同一个数据存储中对数据进行操作，同时它也能为公司进行数据治理带来更多的便利性。那么何为Data Lakehouse呢，它具备些什么个性呢？ 本文参考自https://www.xplenty.com/gloss...://www.xplenty.com/glossary/what-is-a-data-lakehouse/。 Data Lakehouse具备什么个性？始终以来，咱们都在应用两种数据存储形式来架构数据： •数据仓库：数仓这样的一种数据存储架构，它次要存储的是以关系型数据库组织起来的结构化数据。数据通过转换、整合以及清理，并导入到指标表中。在数仓中，数据存储的构造与其定义的schema是强匹配的。•数据湖：数据湖这样的一种数据存储构造，它能够存储任何类型的数据，包含像图片、文档这样的非结构化数据。数据湖通常更大，其存储老本也更为便宜。存储其中的数据不须要满足特定的schema，数据湖也不会尝试去将特定的schema实施其上。相同的是，数据的拥有者通常会在读取数据的时候解析schema（schema-on-read），当解决相应的数据时，将转换施加其上。 当初许多的公司往往同时会搭建数仓、数据湖这两种存储架构，一个大的数仓和多个小的数据湖。这样，数据在这两种存储中就会有肯定的冗余。 Data Lakehouse的呈现试图去交融数仓和数据湖这两者之间的差别，通过将数仓构建在数据湖上，使得存储变得更为便宜和弹性，同时lakehouse可能无效地晋升数据品质，减小数据冗余。在lakehouse的构建中，ETL起了十分重要的作用，它可能将未经规整的数据湖层数据转换成数仓层结构化的数据。 Data Lakehouse概念是由Databricks在此文[1]中提出的，在提出概念的同时，也列出了如下一些个性： •事务反对：Lakehouse能够解决多条不同的数据管道。这意味着它能够在不毁坏数据完整性的前提下反对并发的读写事务。•Schemas：数仓会在所有存储其上的数据上施加Schema，而数据湖则不会。Lakehouse的架构能够依据利用的需要为绝大多数的数据施加schema，使其标准化。•  报表以及剖析利用的反对：报表和剖析利用都能够应用这一存储架构。Lakehouse外面所保留的数据通过了清理和整合的过程，它能够用来减速剖析。同时相比于数仓，它可能保留更多的数据，数据的时效性也会更高，能显著晋升报表的品质。•数据类型扩大：数仓仅能够反对结构化数据，而Lakehouse的构造能够反对更多不同类型的数据，包含文件、视频、音频和系统日志。•端到端的流式反对：Lakehouse能够反对流式剖析，从而可能满足实时报表的需要，实时报表在当初越来越多的企业中重要性在逐步进步。•计算存储拆散：咱们往往应用低成本硬件和集群化架构来实现数据湖，这样的架构提供了十分便宜的分离式存储。Lakehouse是构建在数据湖之上的，因而天然也采纳了存算拆散的架构，数据存储在一个集群中，而在另一个集群中进行解决。•开放性：Lakehouse在其构建中通常会使Iceberg，Hudi，Delta Lake等构建组件，首先这些组件是开源凋谢的，其次这些组件采纳了Parquet，ORC这样凋谢兼容的存储格局作为上层的数据存储格局，因而不同的引擎，不同的语言都能够在Lakehouse上进行操作。 Lakehouse的概念最早是由Databricks所提出的，而其余的相似的产品有Azure Synapse Analytics。Lakehouse技术依然在倒退中，因而下面所述的这些个性也会被一直的订正和改良。 Data lakehouse解决了什么问题那说完了Data Lakehouse的个性，它到底解决了什么问题呢？ 这些年来，在许多的公司里，数仓和数据湖始终并存且各自倒退着，也没有遇到过太过重大的问题。然而仍有一些畛域有值得提高的空间，比方： •数据重复性：如果一个组织同时保护了一个数据湖和多个数仓，这无疑会带来数据冗余。在最好的状况下，这仅仅只会带来数据处理的不高效，然而在最差的状况下，它会导致数据不统一的状况呈现。Data Lakehouse对立了所有，它去除了数据的重复性，真正做到了Single Version of Truth。•高存储老本：数仓和数据湖都是为了升高数据存储的老本。数仓往往是通过升高冗余，以及整合异构的数据源来做到降低成本。而数据湖则往往应用大数据文件系统（譬如Hadoop HDFS）和Spark在便宜的硬件上存储计算数据。而最为便宜的形式是联合这些技术来降低成本，这就是当初Lakehouse架构的指标。•报表和剖析利用之间的差别：报表分析师们通常偏向于应用整合后的数据，比方数仓或是数据集市。而数据科学家则更偏向于同数据湖打交道，应用各种剖析技术来解决未经加工的数据。在一个组织内，往往这两个团队之间没有太多的交加，但实际上他们之间的工作又有肯定的反复和矛盾。而当应用Data Lakehouse后，两个团队能够在同一数据架构上进行工作，防止不必要的反复。•数据停滞（Data stagnation）：在数据湖中，数据停滞是一个最为重大的问题，如果数据始终无人治理，那将很快变为数据沼泽。咱们往往轻易的将数据丢入湖中，但不足无效的治理，长此以往，数据的时效性变得越来越难追溯。Lakehouse的引入，对于海量数据进行catalog，可能更无效地帮忙晋升剖析数据的时效性。•潜在不兼容性带来的危险：数据分析仍是一门衰亡的技术，新的工具和技术每年仍在不停地呈现中。一些技术可能只和数据湖兼容，而另一些则又可能只和数仓兼容。Lakehouse灵便的架构意味着公司能够为将来做两方面的筹备。 Data Lakehouse存在的问题现有的Lakehouse架构仍存在着一些问题，其中最为显著的是： •大一统的架构：Lakehouse大一统的架构有许多的有点，但也会引入一些问题。通常，大一统的架构不足灵活性，难于保护，同时难以满足所有用户的需要，架构师通常更偏向于应用多模的架构，为不同的场景定制不同的范式。•并非现有架构上实质的改良：当初对于Lakehouse是否真的可能带来额定的价值仍存在疑难。同时，也有不同的意见 - 将现有的数仓、数据湖构造与适合的工具联合 - 是否会带来相似的效率呢？•技术尚未成熟：Lakehouse技术以后尚未成熟，在达到上文所提的能力之前仍有较长的路要走。 References[1] 此文: _https://databricks.com/blog/2...

November 28, 2020 · 1 min · jiezi

关于大数据:快手API用户搜索

快手视频API、快手爬虫、快手去水印、快手视频下载、快手视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博分割vx：ifuxing123快手API：用户搜寻申请APIhttp://主机地址/kwshow/search/users?token=xxx&keyword=美女申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词cursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code": 200, "data": { "result": 1, "pcursor": "3", "host-name": "bjzyx-c3910.zqy", "ussid": "MzAwXzE3NTMxODM4OTZfMTYwNTMxNzQ5NDA3Nl9fNjQ5Mg", "users": [ { "kwaiId": "pppjjjy6", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1216146931, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/08/18/16/BMjAyMDA4MTgxNjI2NTNfMTIxNjE0NjkzMV8xX2hkMjMxXzQ4Mg==_s.jpg", "user_text": "用伊对找对象，真的靠谱", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/08/18/16/BMjAyMDA4MTgxNjI2NTNfMTIxNjE0NjkzMV8xX2hkMjMxXzQ4Mg==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/08/18/16/BMjAyMDA4MTgxNjI2NTNfMTIxNjE0NjkzMV8xX2hkMjMxXzQ4Mg==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/08/18/16/BMjAyMDA4MTgxNjI2NTNfMTIxNjE0NjkzMV8xX2hkMjMxXzQ4Mg==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女等你在本地" }, { "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 607954334, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/06/13/17/BMjAyMDA2MTMxNzUzMzNfNjA3OTU0MzM0XzFfaGQ2ODhfNDky_s.jpg", "user_text": "感激相遇，这场生命中最美的遇见，心愿能短暂能开心，不负遇见！", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/06/13/17/BMjAyMDA2MTMxNzUzMzNfNjA3OTU0MzM0XzFfaGQ2ODhfNDky_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/06/13/17/BMjAyMDA2MTMxNzUzMzNfNjA3OTU0MzM0XzFfaGQ2ODhfNDky_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/06/13/17/BMjAyMDA2MTMxNzUzMzNfNjA3OTU0MzM0XzFfaGQ2ODhfNDky_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "琴琴美女来了" }, { "kwaiId": "s520888888", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 298053996, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2019/07/03/16/BMjAxOTA3MDMxNjIyNDZfMjk4MDUzOTk2XzFfaGQ4MzhfMjk2_s.jpg", "user_text": "感激快手提供的绿色直播平台！\n街拍分享不同类型作品和美女????", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2019/07/03/16/BMjAxOTA3MDMxNjIyNDZfMjk4MDUzOTk2XzFfaGQ4MzhfMjk2_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2019/07/03/16/BMjAxOTA3MDMxNjIyNDZfMjk4MDUzOTk2XzFfaGQ4MzhfMjk2_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2019/07/03/16/BMjAxOTA3MDMxNjIyNDZfMjk4MDUzOTk2XzFfaGQ4MzhfMjk2_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "厦门美女街拍榜" }, { "kwaiId": "dazi9309", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 388473775, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/01/29/09/BMjAyMDAxMjkwOTE5NDNfMzg4NDczNzc1XzJfaGQ3OThfNDMx_s.jpg", "user_text": "带你们看什么叫真正的美女\n如果口味雷同，请留个关注", "user_sex": "M", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/01/29/09/BMjAyMDAxMjkwOTE5NDNfMzg4NDczNzc1XzJfaGQ3OThfNDMx_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/01/29/09/BMjAyMDAxMjkwOTE5NDNfMzg4NDczNzc1XzJfaGQ3OThfNDMx_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/01/29/09/BMjAyMDAxMjkwOTE5NDNfMzg4NDczNzc1XzJfaGQ3OThfNDMx_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "达哥（珍藏美女）" }, { "kwaiId": "mote5566", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 2058895067, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/10/24/12/BMjAyMDEwMjQxMjI5MTJfMjA1ODg5NTA2N18xX2hkODhfNTMw_s.jpg", "user_text": "感激快手提供平台：", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/10/24/12/BMjAyMDEwMjQxMjI5MTJfMjA1ODg5NTA2N18xX2hkODhfNTMw_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/10/24/12/BMjAyMDEwMjQxMjI5MTJfMjA1ODg5NTA2N18xX2hkODhfNTMw_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/10/24/12/BMjAyMDEwMjQxMjI5MTJfMjA1ODg5NTA2N18xX2hkODhfNTMw_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女模特" }, { "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1657623, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/11/12/11/BMjAyMDExMTIxMTU2MjFfMTY1NzYyM18xX2hkODI5XzY0NA==_s.jpg", "user_text": "关注我，你就是姐姐的人了，要开心哟^_^\n如有侵权请告知删除", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/11/12/11/BMjAyMDExMTIxMTU2MjFfMTY1NzYyM18xX2hkODI5XzY0NA==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/11/12/11/BMjAyMDExMTIxMTU2MjFfMTY1NzYyM18xX2hkODI5XzY0NA==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/11/12/11/BMjAyMDExMTIxMTU2MjFfMTY1NzYyM18xX2hkODI5XzY0NA==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "姐姐带你看美女" }, { "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1970546107, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/09/10/08/BMjAyMDA5MTAwODQwNDFfMTk3MDU0NjEwN18xX2hkNTQ4XzM3NA==_s.jpg", "user_text": "自己独身\n\n喜爱就关注我一下吧", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/09/10/08/BMjAyMDA5MTAwODQwNDFfMTk3MDU0NjEwN18xX2hkNTQ4XzM3NA==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/09/10/08/BMjAyMDA5MTAwODQwNDFfMTk3MDU0NjEwN18xX2hkNTQ4XzM3NA==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/09/10/08/BMjAyMDA5MTAwODQwNDFfMTk3MDU0NjEwN18xX2hkNTQ4XzM3NA==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女裁判太阳姐" }, { "kwaiId": "dedaoxitong", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 31896005, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/07/20/22/BMjAyMDA3MjAyMjA0MTVfMzE4OTYwMDVfMV9oZDI4N18xOTU=_s.jpg", "user_text": "谢谢你的关注 每天中午12点 早晨八点更新视频\n早晨八点直播\n????助理V：15685723805\n????守业V:weo1818\n????记住我的名字和我带给你的故事！", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/07/20/22/BMjAyMDA3MjAyMjA0MTVfMzE4OTYwMDVfMV9oZDI4N18xOTU=_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/07/20/22/BMjAyMDA3MjAyMjA0MTVfMzE4OTYwMDVfMV9oZDI4N18xOTU=_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/07/20/22/BMjAyMDA3MjAyMjA0MTVfMzE4OTYwMDVfMV9oZDI4N18xOTU=_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "我的美女BOSS呀" }, { "kwaiId": "liuwei0828", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 767396765, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/08/06/06/BMjAyMDA4MDYwNjQ4NDBfNzY3Mzk2NzY1XzFfaGQ4MDdfNDA3_s.jpg", "user_text": "喜爱的仍旧喜爱着。❤️", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/08/06/06/BMjAyMDA4MDYwNjQ4NDBfNzY3Mzk2NzY1XzFfaGQ4MDdfNDA3_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/08/06/06/BMjAyMDA4MDYwNjQ4NDBfNzY3Mzk2NzY1XzFfaGQ4MDdfNDA3_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/08/06/06/BMjAyMDA4MDYwNjQ4NDBfNzY3Mzk2NzY1XzFfaGQ4MDdfNDA3_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "刘大美女.❣" }, { "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1046313745, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/07/28/18/BMjAyMDA3MjgxODI1NDJfMTA0NjMxMzc0NV8yX2hkNjRfOTQw_s.jpg", "user_text": "想看美女就点关注。", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/07/28/18/BMjAyMDA3MjgxODI1NDJfMTA0NjMxMzc0NV8yX2hkNjRfOTQw_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/07/28/18/BMjAyMDA3MjgxODI1NDJfMTA0NjMxMzc0NV8yX2hkNjRfOTQw_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/07/28/18/BMjAyMDA3MjgxODI1NDJfMTA0NjMxMzc0NV8yX2hkNjRfOTQw_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "图片美女姐" }, { "kwaiId": "UFMT99ha", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1740024015, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/02/20/23/BMjAyMDAyMjAyMzI5MzlfMTc0MDAyNDAxNV8xX2hkNTAwXzY3MQ==_s.jpg", "user_text": "感激快手官网呀 爱宁????\n⭐️UFMT88（接推）备注来意\n喜爱美女 分享美女 可投稿！", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/02/20/23/BMjAyMDAyMjAyMzI5MzlfMTc0MDAyNDAxNV8xX2hkNTAwXzY3MQ==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/02/20/23/BMjAyMDAyMjAyMzI5MzlfMTc0MDAyNDAxNV8xX2hkNTAwXzY3MQ==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/02/20/23/BMjAyMDAyMjAyMzI5MzlfMTc0MDAyNDAxNV8xX2hkNTAwXzY3MQ==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女鉴定所8" }, { "kwaiId": "wml23876asd", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1812432980, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/11/13/23/BMjAyMDExMTMyMzA0NTNfMTgxMjQzMjk4MF8yX2hkNjg3XzY3NQ==_s.jpg", "user_text": "拿原图➕QQ：10339159（相册）\n接推广（骗人不要来）或者投稿 加Q3095616832 格调不定", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/11/13/23/BMjAyMDExMTMyMzA0NTNfMTgxMjQzMjk4MF8yX2hkNjg3XzY3NQ==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/11/13/23/BMjAyMDExMTMyMzA0NTNfMTgxMjQzMjk4MF8yX2hkNjg3XzY3NQ==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/11/13/23/BMjAyMDExMTMyMzA0NTNfMTgxMjQzMjk4MF8yX2hkNjg3XzY3NQ==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女生吃一个人" }, { "kwaiId": "sm090717", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 75586604, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/03/07/22/BMjAyMDAzMDcyMjE5MzVfNzU1ODY2MDRfMV9oZDY3Nl81MjI=_s.jpg", "user_text": "????她正在关注你哦\n\n私信有空就回，个别不看私信????", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/03/07/22/BMjAyMDAzMDcyMjE5MzVfNzU1ODY2MDRfMV9oZDY3Nl81MjI=_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/03/07/22/BMjAyMDAzMDcyMjE5MzVfNzU1ODY2MDRfMV9oZDY3Nl81MjI=_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/03/07/22/BMjAyMDAzMDcyMjE5MzVfNzU1ODY2MDRfMV9oZDY3Nl81MjI=_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "i-美女女????" }, { "kwaiId": "jltd7777", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 1854383536, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/10/02/11/BMjAyMDEwMDIxMTAwMDRfMTg1NDM4MzUzNl8yX2hkMjk0XzQ3Ng==_s.jpg", "user_text": "世界美女尽收眼底", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/10/02/11/BMjAyMDEwMDIxMTAwMDRfMTg1NDM4MzUzNl8yX2hkMjk0XzQ3Ng==_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/10/02/11/BMjAyMDEwMDIxMTAwMDRfMTg1NDM4MzUzNl8yX2hkMjk0XzQ3Ng==_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/10/02/11/BMjAyMDEwMDIxMTAwMDRfMTg1NDM4MzUzNl8yX2hkMjk0XzQ3Ng==_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女模特" }, { "kwaiId": "xiaotiantian666", "following": false, "verified": false, "visitorBeFollowed": false, "user_id": 531508502, "headurl": "https://tx2.a.yximgs.com/uhead/AB/2020/06/24/18/BMjAyMDA2MjQxODU1MDhfNTMxNTA4NTAyXzFfaGQ2NjRfODE2_s.jpg", "user_text": "????感激陪伴 你来我激情相拥\n\n只有一个v✉️：1021053253", "user_sex": "F", "headurls": [ { "cdn": "tx2.a.yximgs.com", "url": "https://tx2.a.yximgs.com/uhead/AB/2020/06/24/18/BMjAyMDA2MjQxODU1MDhfNTMxNTA4NTAyXzFfaGQ2NjRfODE2_s.jpg" }, { "cdn": "js2.a.yximgs.com", "url": "https://js2.a.yximgs.com/uhead/AB/2020/06/24/18/BMjAyMDA2MjQxODU1MDhfNTMxNTA4NTAyXzFfaGQ2NjRfODE2_s.jpg", "urlPattern": "https://js2.a.yximgs.com/uhead/AB/2020/06/24/18/BMjAyMDA2MjQxODU1MDhfNTMxNTA4NTAyXzFfaGQ2NjRfODE2_s.jpg@base@tag%3DimgScale%26r%3D0%26q%3D85%26w%3D{w}%26h%3D{h}%26rotate" } ], "isFavorited": false, "user_name": "美女姐姐_Tian????" } ] }, "msg": "success", "app": "kwshow"}

November 27, 2020 · 3 min · jiezi

关于大数据:轻量级大数据-ETL-开发框架

首先在进入主题之前咱们先来回顾下经典的大数据ETL架构有哪些？ Lambda架构 Kappa架构 混合架构 它们之间的区别如下： 七牛的大数据平台在搭建过程中也经验了下面几个架构的变迁，也就是从最早的Lambda架构，到尝试应用Kappa架构，再到前面的新型混合ETL架构，为了满足业务需要，开发人员在这几个架构中进行折中抉择，然而咱们发现下面几个架构对于大数据的开发人员要求较高，次要体现在上面几个方面： 波及到泛滥的框架，如流解决框架就有晚期的Apache Storm，到前面的Apache Spark Streaming,再到Apache Flink，学习门槛较高不同计算框架对与数据源的定义不对立，造成输入输出较难治理数据开发人员新开发一个业务指标，不同开发人员写出的代码格调不对立，开发效率低，很难进行工程化，前期保护也必将艰难为了解决下面的几个问题，团队抉择基于Apache Spark开发了QStreaming这套简略轻量级ETL开发框架 QStreaming个性数据源反对Apache KafkaApache HbaseHadoop HDFS/S3JdbcMongoDBApache Hudi次要个性DDL定义输出源 这外面stream关键字代表定义了一个流表，并且是连贯到kafka消息中间件 流解决watermark的DSL反对在DSL中增加watermark，次要有2种形式: 在DDL中指定， 在create view 语句中指定 动静UDF比方上面这个转换一个日期字符串为工夫戳格局 流解决的多输入 这个个性次要是通过spark structed streaming的forEachBatch实现的 变量渲染变量渲染常常在一些定时调度批处理中十分有用，如下依据小时读取一个HDFS上的parquet文件 监控，如kafka lag监控因为Apache spark生产kafka是应用的低阶API，默认咱们没有方法晓得生产的topic有没有提早， 咱们通过指定group-id属性，模仿kafka consumer的subscribe模式，这样就和一般的kafka consumer 高级API一样了 数据品质 这个个性次要是用来对数据做单元测试的，比方校验咱们ETL后果表的准确性 QStreaming残缺的语法个性参考这里 QStreaming架构 架构图 外围组件从下面的架构图中能够看出QStreaming次要有以下几个组件组成 Pipeline DSLPipeline DSL是一个定义时的Job工作形容文件，相似于SQL语法，对Spark SQL齐全兼容，比方上面这个 Pipeline DSL ParserPipeline DSL Parser组件负责解析Pipeline DSL并且转换ANTLR AST为Pipeline Domain Models Pipeline Domain models Pipleine TranslatorPipeline Translator进一步将Pipeline domain model转换为spark transformations和actions ...

November 25, 2020 · 1 min · jiezi

关于大数据:数据系统架构5实时离线统计系统

5.实时离线统计零碎一、序在有了日志等数据之后，咱们须要依据业务方的需要来统计各类数据报表以供业务剖析应用。这里咱们分两个方向离线和实时，都是从零到一随着技术的倒退逐渐建设和倒退欠缺起来的。因为都是通过肯定的模型进行统计，统称为模型化统计零碎。 原始阶段：在各种技术刚刚起步的阶段，对于各种需要根本都是手动编码去做一下定制化统计与展现； 初始阶段：离线和实时的数据统计，在没有指标零碎之前，都是通过形象日志，造成对应的统计规定，而后统计程序依据配置的规定进行解析与统计； 倒退阶段：通过多维数仓、实时技术的倒退，与各种剖析组件买通，比方kylin、druid、clickhouse实现数据的统计与剖析； 指标零碎阶段：由实时离线统计零碎，解析指标管理系统的配置信息，进行数据的统计工作，从而保证数据口径的统一。 二、离线后期：定制化统计大多数公司，都是从定制化开发开始做数据分析的工作，比方最开始针对不同的数据分析需要编写对应的MapReduce程序；针对对应的报表写hive sql统计成后果表，再抽取到mysql进行数据分析与展现...很多状况下都是烟囱式开发，毛病显著：1、保护开发成本高；2、不成体系，逻辑无奈复用；3、计算资源的节约。为了解决这些问题，咱们开发了一个MapReduce的离线统计零碎，就是上面所述的单维模型统计零碎。 中期：单维模型统计与展现为了解决一些常见的离线的数据统计，首先咱们定义了一个后端日志、前端日志的统计模型，在这个模型的根底之下来定义指标，在该零碎下只能对一个指标只能做确定性的维度精选统计，比方统计品类下A、B的数据，咱们须要配置成2个指标来进行统计，指标反对pv、uv、sum、top统计。这样在后端统计程序上能够绝对简略的实现对应的统计，缩小了后端复杂度，减少了可靠性。 咱们统计好了数据之后，有对应的展现零碎来做数据的展现，咱们能够通过组合各种指标来造成对应的报表。这套零碎在前中期为咱们解决了一部分一般的统计需要。 当然，这个零碎也是有局限性的，1、对多维分析反对的不够敌对 2、展现的单一性 3、整体上不够灵便，在肯定范畴内实现了配置化统计。这种模式根本也就是实现了通知你数据是怎么的，不可能进行摸索式剖析，充沛的挖掘数据价值。 以后：多维明细数仓+kylin/clickhouse （多维分析）当初更多的状况是采纳数仓明细表+数据分析的各种组件组合这样的形式，这样咱们充沛的施展了数据仓库的价值，保障了逻辑的复用口径的对立，因为kylin、clickhouse的特点不同，咱们能够针对不同需要数据的特定抉择接入到不同的剖析组件下，来实现疾速的OLAP数据分析。因为这些计算剖析的组件，根本都反对sql化的查问，为后续的数据对立的展现对接打下了较好的根底。 以后：SQL模板与数据提取 （圈群提取与剖析）这套零碎是针对业务经营、产品人员疾速的提取数据所设计的。实质上是通过事后配置好的SQL模板，来帮忙不会写sql的经营、产品实现数据统计SQL逻辑的开发。相当于用户标签画像的雏形后期阶段。后续依据这套统计零碎扩大了留存、漏斗、标签模型的计算。 SQL模板的定义：配置一个SQL模板，形容对应的sql须要填写哪些参数，应用对应的占位符进行填充，指定对应的占位符应用哪个维度来解析，比方：是日期、品类、城市，这样能够通过下拉框来确定具体执行的sql。 模板关系：通过配置各个模板SQL所筛选进去的人群，能够对各个模板的人群做交加、或集等汇合逻辑运算，最终获取到对应满足条件的人群。 数据的计算：在参数与关系确定的状况下，咱们通过hive JDBC的形式管制工作的执行与数据的下载。 这个套零碎解决了业务人员提取数据的需要，是帮忙不会写sql的人员用图形化的形式实现业务sql逻辑的编写。当然这个套零碎也有着显著的毛病：1、实现了sql模板的复用，然而重复性计算，节约了计算资源 2、逻辑绝对黑盒，无奈积淀成对应的数据仓库表，导致sql模板在肯定水平上的局限，不能把数据积淀下来 3、业务逻辑变动时须要更新对应模板 在此基础上咱们后续从新设计开发了用户标签零碎，做了如下的改良1、保留了sql模板，不过这个模板是为了能够对接各个业务方的标签数据，比方：搜寻举荐的标签库、风控的标签、也能够比拟不便的对接到已在数仓的标签表。相对来说用sql模板保留了扩展性。2、数据标签后果可积淀数仓，这样相当于生成了对应的标签数仓表，各个剖析或业务团队能够间接应用与对接，对立标签规范。3、引入clickhouse组件，放慢标签数据提取效率。绝对与之前的hive jdbc，也是一个预计算的过程，因为预计算能够实现更快的数据查问与提取。 三、实时实时统计零碎的倒退整体上与离线统计的倒退相似，实时的流式解决，向着sql化与批流对立的方向一直的提高与倒退，从最开始的storm、spark、spark streaming、flink，一直的提高晋升性能，解决各种实时问题，加强性能。各种后续相干的零碎也随之应运而生。 后期：定制化统计在这个阶段，咱们次要是依据用户的实时需要，依照特定的业务逻辑编写对应的storm程序进行数据统计，最终把后果落地到hbase当中，以供后续查问零碎进行查问与数据展现。在实时模型化统计不能反对的状况下，还须要采纳这种形式应用flink等对非凡数据进行统计与解决。 以后：模型化配置统计kafka日志形象：针对不同的topic日志，对日志进行形象配置，指定分隔符和日志行对应的字段信息等监控项：通过配置好的日志行，来定义监控项生成对应的统计规定，包含条件、维度组合、维度主动发现等等数据展现：通过前端平台依照特定的数据逻辑来查问对应实时的数据后果 实时模型化统计，整个后端计算引擎最开始咱们应用storm，后续逐渐降级spark streaming版本，以及flink版本，依据不同的技术特定引入了新的统计形式的反对，比方flink的join操作等。后续能够扩大后果数据能够写入到不同的目的地当中。 以后：实时数据处理+druid同离线数据一样，实时咱们也有着各种多维分析的场景，这里咱们应用实时的流式解决技术把数据洗如到druid当中，而后应用druid做实时多维分析的查问与后果数据的展现。 四、瞻望对立指标模型零碎：实时离线统计零碎对立对接一套统计模型管理系统，最大水平上保障实时离线数据口径的一致性；批流合一：随着流式解决的倒退、实时数仓等建设，逐渐实现实时、离线统计零碎的合并，只保留一套统计零碎，缩小各种计算资源的节约。

November 24, 2020 · 1 min · jiezi

关于大数据:一文带你读懂华为云在ACMUG技术沙龙上都透露了些啥

摘要：近日，华为云数据库业务总裁苏光牛在ACMUG中国MySQL用户组主办的 “华为云专场” 技术沙龙中分享了华为云数据库重磅新品GaussDB的外围能力与竞争劣势。那么， GaussDB产品到底有哪些亮点呢？11月18日，由ACMUG中国MySQL用户组主办的 “华为云专场” 技术沙龙在北京进行，华为云数据库业务总裁苏光牛及多位技术专家在会上分享了华为云数据库重磅新品GaussDB的外围能力与竞争劣势。 本次沙龙中，苏光牛提到：将来云数据库会朝多元化、凋谢交融、云原生分布式方向倒退，智能运维与自治数据库会大有可为。云数据库须要依据市场变动和客户需要，一直进行产品和技术创新，解决数据库卡脖子的问题，以当先的技术和服务推动云数据库跃迁式倒退。华为云数据库会以全新品牌GaussDB为站点，面向全场景，服务全行业，继续翻新，打造企业级云数据库服务。 ACMUG华为云专场数据库技术闭门讨论会现场图 华为云数据库资深内核专家饶珑辉，对华为云MySQL系列产品若干内核个性进行了分享。如云数据库RDS for MySQL提供的全量SQL日志、连接线程池、SQL防火墙、热点更新优化、表回收站、复制双通道等能力劣势。华为云新一代高性能企业级分布式数据库GaussDB(for MySQL) 除具备RDS for MySQL所有能力外，还提供了高达128TB的海量存储，反对1写15读的只读节点极速扩大，可实现超百万级QPS吞吐，齐全兼容MySQL，单节点相比原生MySQL性能晋升7倍，反对跨AZ部署，数据0失落。 华为云数据库产品总监张昆，分享了华为云数据库GaussDB的产品变革与实际。他提到，云、AI、5G等技术驱动数据库行业新需要，云数据库一直演进降级。依靠华为云与华为云Stack，通过全栈软硬件优化，华为云GaussDB进行了进阶与变革，以对立的分布式架构，反对关系型与非关系型的数据库引擎，并分享了GaussDB在金融、电商、游戏等行业中的优良实际。在关系型畛域，GaussDB除反对华为开源生态openGauss外，也100%兼容MySQL和PostgreSQL凋谢生态，存储容量更大，性能更优，实用于企业多样化的数据库利用场景。非关系型畛域，GaussDB 100%反对MongoDB、Cassandra、Redis、InfluxDB等NoSQL协定接口，提供极致性能、企业级可靠性、灵便全托管等服务能力。 华为云数据库资深内核专家范逸鸣，分享了华为云GaussDB(openGauss)社区及商业版的要害个性。GaussDB(openGauss)是华为云深度交融数据库畛域多年教训，联合企业级场景需要，推出的新一代企业级分布式数据库。openGauss社区版以集中式主备部署为状态，继承GaussDB稳固牢靠、高性能、丰盛个性等劣势，同时积极参与openGauss社区，放弃长期演进。GaussDB(openGauss)商业版架构上着重构筑传统数据库的企业级能力和互联网分布式数据库的高扩大和高可用能力，在撑持传统业务的根底上，继续构建高性能、高平安、生态兼容等竞争劣势，为企业面向5G时代的挑战，提供了有限可能。 此外，华为云数据库MySQL生态域研发总监肖永，还联合客户实际讲述了GaussDB(for MySQL)从云化到Cloud Native的演进之路。他示意：数据库曾经倒退了三十多年，传统数据库架构在新的介质、需要下曾经有所瓶颈，同时客户业务一直进化，大数据量、中心化解决趋势显著。针对变动，华为基于本身上云教训，在下一代存储DFV上打造了企业级Cloud Native数据库产品GaussDB(for MySQL) ，基于存算拆散的分布式架构提供了优于开源MySQL 7倍性能、故障闪复原、分钟级疾速备份和复原TB级数据等能力。 基于丰盛的产品线和优良的技术能力，华为云数据库服务已在500+大客户中规模商用，遍布金融、政府、电信、能源、交通、物流、电商等行业。将来，华为云数据库将继续构建技术硬实力和优良解决方案，使能行业数字化转型。 Ps：错过直播的小伙伴们，能够点击链接回顾：https://live.bilibili.com/22257582 点击关注，第一工夫理解华为云陈腐技术~

November 24, 2020 · 1 min · jiezi

关于大数据:抖音Api带同款商品视频列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音Api：带同款商品视频列表申请Apihttp://主机地址/douyin/promotion/videos?token=xxx&pid=61088777146700申请形式GET参数字段类型阐明tokenstring接口受权码pidint商品的promotion_id返回示例{ "code":200, "data":{ "extra":{ "fatal_item_ids":[ ], "logid":"2020091423131701012912923017205465", "now":1600096397000 }, "log_pb":{ "impr_id":"2020091423131701012912923017205465" }, "same_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "anchors":null, "author":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p9-dy.byteimg.com/img/2f7510004166caf1c896f~c5_168x168.webp?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/2f7510004166caf1c896f~c5_168x168.webp?from=4010531038", "https://p29-dy.byteimg.com/img/2f7510004166caf1c896f~c5_168x168.webp?from=4010531038" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p29-dy.byteimg.com/img/2f7510004166caf1c896f~c5_300x300.webp?from=4010531038", "https://p26-dy.byteimg.com/img/2f7510004166caf1c896f~c5_300x300.webp?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/2f7510004166caf1c896f~c5_300x300.webp?from=4010531038" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p29-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p26-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "avatar_uri":"2f7510004166caf1c896f", "aweme_count":0, "bind_phone":"", "birthday":"1992-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":12, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":0, "fb_expire_time":0, "follow_status":0, "follower_count":0, "follower_status":0, "followers_detail":null, "following_count":0, "gender":2, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":false, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"小仙女穿搭", "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAAJc213DaWgkI_wekV84O-LJj9sYQBHpRtS0c_yluy-Ug", "secret":0, "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"2922604929", "show_image_bubble":false, "signature":"保持每天上新????关注我，让你每天搭配不一样????", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":0, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"910026647016429", "unique_id":"dym1hj4c0jap", "unique_id_modify_time":1600096397, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":true, "with_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"", "youtube_expire_time":0 }, "author_user_id":910026647016429, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6789912376708762888", "aweme_type":0, "bodydance_score":0, "cha_list":[ { "author":{ "ad_cover_url":null, "can_set_geofencing":null, "cha_list":null, "cover_url":null, "followers_detail":null, "geofencing":null, "homepage_bottom_toast":null, "item_list":null, "need_points":null, "new_story_cover":null, "platform_sync_info":null, "relative_users":null, "type_label":null, "user_tags":null, "white_cover_url":null }, "banner_list":null, "cha_attrs":null, "cha_name":"这么穿显瘦20斤", "cid":"1636758346583044", "collect_stat":0, "connect_music":[ ], "desc":"", "extra_attr":{ "is_live":false }, "hashtag_profile":"282be0003fa3b708279e8", "is_challenge":0, "is_commerce":false, "is_pgcshow":false, "schema":"aweme://aweme/challenge/detail?cid=1636758346583044", "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"我在抖音加入#这么穿显瘦20斤 ", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"我在抖音加入#这么穿显瘦20斤 ", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/challenge/1636758346583044/?u_code=0", "share_weibo_desc":"我在抖音加入#这么穿显瘦20斤 " }, "show_items":null, "sub_type":0, "type":2, "user_count":0, "view_count":0 } ], "challenge_position":null, "city":"370400", "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "commerce_info":{ }, "cover_labels":null, "create_time":1580899671, "desc":"超遮肉的春款穿搭，最初一套瘦哭你@DOU+小助手 #这么穿显瘦20斤 #2020鼠年上上签", "desc_language":"zh", "descendants":{ "notify_msg":"头条", "platforms":[ "toutiao" ] }, "distance":"", "distribute_type":1, "duration":12667, "geofencing":[ ], "geofencing_regions":null, "group_id":"6789912376708762888", "has_vs_entry":true, "have_dashboard":false, "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_ads":false, "is_fantasy":false, "is_hash_tag":1, "is_pgcshow":false, "is_preview":0, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "item_stitch":0, "label_top_text":null, "long_video":null, "music":{ "album":"", "artists":[ ], "audition_duration":12, "author":"小仙女穿搭", "author_deleted":false, "author_position":null, "avatar_large":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p9-dy.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "binded_challenge_id":0, "collect_stat":0, "cover_hd":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "cover_large":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "cover_medium":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p9-dy.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "cover_thumb":{ "height":720, "uri":"2f7510004166caf1c896f", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/2f7510004166caf1c896f.jpeg?from=4010531038" ], "width":720 }, "dmv_auto_show":false, "duration":12, "end_time":0, "external_song_info":[ ], "extra":"{"review_unshelve_reason":0,"beats":{},"hotsoon_review_time":-1,"has_edited":0,"reviewed":1,"music_label_id":null,"aggregate_exempt_conf":[],"douyin_beats_info":{},"schedule_search_time":0}", "id":6789895472372665091, "id_str":"6789895472372665091", "is_audio_url_with_cookie":false, "is_commerce_music":false, "is_del_video":false, "is_matched_metadata":false, "is_original":false, "is_original_sound":true, "is_pgc":false, "is_restricted":false, "is_video_self_see":false, "lyric_short_position":null, "mid":"6789895472372665091", "mute_share":false, "offline_desc":"", "owner_handle":"dym1hj4c0jap", "owner_id":"910026647016429", "owner_nickname":"小仙女穿搭", "play_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/1657690932650019.mp3", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/1657690932650019.mp3", "http://p1-dy.byteimg.com/obj/ies-music/1657690932650019.mp3" ], "width":720 }, "position":null, "prevent_download":false, "prevent_item_download_status":0, "preview_end_time":0, "preview_start_time":0, "reason_type":0, "redirect":false, "schema_url":"", "sec_uid":"MS4wLjABAAAAJc213DaWgkI_wekV84O-LJj9sYQBHpRtS0c_yluy-Ug", "shoot_duration":12, "source_platform":23, "start_time":0, "status":1, "strong_beat_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1657870132922376", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1657870132922376", "http://p1-dy.byteimg.com/obj/ies-music/strong_beat/1657870132922376" ], "width":720 }, "tag_list":null, "title":"@小仙女穿搭创作的原声", "unshelve_countries":null, "user_count":0 }, "need_vs_entry":true, "nickname_position":null, "origin_comment_ids":null, "poi_patch_info":{ "item_patch_poi_prompt_mark":0 }, "position":null, "prevent_download":false, "promotion_other_info":{ "recall_reason":"" }, "promotions":[ ], "rate":12, "region":"CN", "report_action":false, "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"#在抖音，记录美好生活#超遮肉的春款穿搭，最初一套瘦哭你@DOU+小助手 #这么穿显瘦20斤 #2020鼠年上上签", "share_link_desc":"超遮肉的春款穿搭，最初一套瘦哭你@DOU+小助手 #这么穿显瘦20斤 #2020鼠年上上签 %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"超遮肉的春款穿搭，最初一套瘦哭你@DOU+小助手 #这么穿显瘦20斤 #2020鼠年上上签", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6789912376708762888/?region=CN&mid=6789895472372665091&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#超遮肉的春款穿搭，最初一套瘦哭你@DOU+小助手 #这么穿显瘦20斤 #2020鼠年上上签" }, "share_url":"https://www.iesdouyin.com/share/video/6789912376708762888/?region=CN&mid=6789895472372665091&u_code=0&titleType=title", "simple_promotions":"[{"promotion_id":"61116606267400","product_id":"611166062674","title":"MIUCO重工百褶荷叶边翻领衬衫+针织马甲收腰套装女装2020春秋","price":16500,"sales":248,"elastic_images":[{"uri":"cmp-ecom-alliance/FtzDWxP5QFY8jFDs6jGZiB5xwH4t.jpg","url_list":["http://p1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FtzDWxP5QFY8jFDs6jGZiB5xwH4t.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FtzDWxP5QFY8jFDs6jGZiB5xwH4t.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FtzDWxP5QFY8jFDs6jGZiB5xwH4t.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FjWNms1xe-9VD9zQYf9sJQaO8Bxg.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjWNms1xe-9VD9zQYf9sJQaO8Bxg.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjWNms1xe-9VD9zQYf9sJQaO8Bxg.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjWNms1xe-9VD9zQYf9sJQaO8Bxg.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FpK0ti42k1MtbmviUZPemyuxWEZx.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FpK0ti42k1MtbmviUZPemyuxWEZx.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FpK0ti42k1MtbmviUZPemyuxWEZx.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FpK0ti42k1MtbmviUZPemyuxWEZx.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FrlkxRsmPcfpkIkfZHH5DQRFOsSg.jpg","url_list":["http://p9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrlkxRsmPcfpkIkfZHH5DQRFOsSg.jpg.jpeg","http://pb1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrlkxRsmPcfpkIkfZHH5DQRFOsSg.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrlkxRsmPcfpkIkfZHH5DQRFOsSg.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FkI89kEIKUuxJEpUPcasSlgZwSeY.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FkI89kEIKUuxJEpUPcasSlgZwSeY.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FkI89kEIKUuxJEpUPcasSlgZwSeY.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FkI89kEIKUuxJEpUPcasSlgZwSeY.jpg.jpeg"],"width":720,"height":720}],"promotion_source":7,"card_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/","ies_category":2,"meta_param":"{\"is_star_atlas\":false}","goods_source":"来自淘宝"},{"promotion_id":"61039354274000","product_id":"610393542740","title":"MIUCO女人味圆领拼接星星网纱鱼尾摆荷叶边连衣裙女2020春装新款k","price":23320,"sales":1,"elastic_images":[{"uri":"cmp-ecom-alliance/Fixh3g9iynBkH9r6xhAbSdSyhL8i.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fixh3g9iynBkH9r6xhAbSdSyhL8i.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fixh3g9iynBkH9r6xhAbSdSyhL8i.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fixh3g9iynBkH9r6xhAbSdSyhL8i.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Frjd138uiMc2VxWsq_jjNXjxp42A.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Frjd138uiMc2VxWsq_jjNXjxp42A.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Frjd138uiMc2VxWsq_jjNXjxp42A.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Frjd138uiMc2VxWsq_jjNXjxp42A.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Ft2WcUPUr022gkserAJHjJy9gljZ.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Ft2WcUPUr022gkserAJHjJy9gljZ.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Ft2WcUPUr022gkserAJHjJy9gljZ.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Ft2WcUPUr022gkserAJHjJy9gljZ.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fk2t9ZYg1a8Cd52IlzNaWvEsgZzm.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fk2t9ZYg1a8Cd52IlzNaWvEsgZzm.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fk2t9ZYg1a8Cd52IlzNaWvEsgZzm.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fk2t9ZYg1a8Cd52IlzNaWvEsgZzm.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FhoGhyy0kpuAGKM36BtFfUR-HW3y.jpg","url_list":["http://p1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FhoGhyy0kpuAGKM36BtFfUR-HW3y.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FhoGhyy0kpuAGKM36BtFfUR-HW3y.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FhoGhyy0kpuAGKM36BtFfUR-HW3y.jpg.jpeg"],"width":720,"height":720}],"promotion_source":7,"card_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/","ies_category":2,"meta_param":"{\"is_star_atlas\":false}","goods_source":"来自淘宝"},{"promotion_id":"61027341226600","product_id":"610273412266","title":"MIUCO针织马甲+复旧格子领带灯笼袖衬衫裙两件套女装2020春装款k","price":26920,"sales":2,"elastic_images":[{"uri":"cmp-ecom-alliance/FsZkMba_ZD2TXSyEz-ma5uSfWh77.jpg","url_list":["http://p9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FsZkMba_ZD2TXSyEz-ma5uSfWh77.jpg.jpeg","http://pb1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FsZkMba_ZD2TXSyEz-ma5uSfWh77.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FsZkMba_ZD2TXSyEz-ma5uSfWh77.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FgcSl3VO0wmiFhGpXthnp80frM9y.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgcSl3VO0wmiFhGpXthnp80frM9y.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgcSl3VO0wmiFhGpXthnp80frM9y.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgcSl3VO0wmiFhGpXthnp80frM9y.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fhxb59OiITclZy-oanERScL0W9Kr.jpg","url_list":["http://p1.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fhxb59OiITclZy-oanERScL0W9Kr.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fhxb59OiITclZy-oanERScL0W9Kr.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fhxb59OiITclZy-oanERScL0W9Kr.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FgyPuanIL9gSeaUNwfPdbVcac7SV.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgyPuanIL9gSeaUNwfPdbVcac7SV.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgyPuanIL9gSeaUNwfPdbVcac7SV.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgyPuanIL9gSeaUNwfPdbVcac7SV.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FmRE6kpv-1iOaKv72JiIrbFzSrig.jpg","url_list":["http://p9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FmRE6kpv-1iOaKv72JiIrbFzSrig.jpg.jpeg","http://pb1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FmRE6kpv-1iOaKv72JiIrbFzSrig.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FmRE6kpv-1iOaKv72JiIrbFzSrig.jpg.jpeg"],"width":720,"height":720}],"promotion_source":7,"card_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/","ies_category":2,"meta_param":"{\"is_star_atlas\":false}","goods_source":"来自淘宝"},{"promotion_id":"61079460198100","product_id":"610794601981","title":"MIUCO法式小马印花收腰显瘦时尚气质百褶裙连衣裙女2020早春k","price":24220,"sales":2,"elastic_images":[{"uri":"cmp-ecom-alliance/FrzhyDysoCnKUyfjMQndwHbN9nOL.jpg","url_list":["http://p1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrzhyDysoCnKUyfjMQndwHbN9nOL.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrzhyDysoCnKUyfjMQndwHbN9nOL.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrzhyDysoCnKUyfjMQndwHbN9nOL.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FvTUhiIKxhgBVgjOABJA49ATRiJb.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FvTUhiIKxhgBVgjOABJA49ATRiJb.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FvTUhiIKxhgBVgjOABJA49ATRiJb.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FvTUhiIKxhgBVgjOABJA49ATRiJb.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FrtwORimZ6ejrJNw-n80B-D6EHcr.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrtwORimZ6ejrJNw-n80B-D6EHcr.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrtwORimZ6ejrJNw-n80B-D6EHcr.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FrtwORimZ6ejrJNw-n80B-D6EHcr.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fn1P4vRt0yZYalX74pBXYTqIlpb_.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fn1P4vRt0yZYalX74pBXYTqIlpb_.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fn1P4vRt0yZYalX74pBXYTqIlpb_.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fn1P4vRt0yZYalX74pBXYTqIlpb_.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FgXZeDGXHd1so58poxjV72nlKb_u.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgXZeDGXHd1so58poxjV72nlKb_u.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgXZeDGXHd1so58poxjV72nlKb_u.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FgXZeDGXHd1so58poxjV72nlKb_u.jpg.jpeg"],"width":720,"height":720}],"promotion_source":7,"card_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/","ies_category":2,"meta_param":"{\"is_star_atlas\":false}","goods_source":"来自淘宝"},{"promotion_id":"61121574681700","product_id":"611215746817","title":"MIUCO御姐范儿立领钉珠打缆袖口收腰大摆碎花裙女装2020春秋新款k","price":25120,"sales":8,"elastic_images":[{"uri":"cmp-ecom-alliance/Fo5hZiAmD9-vhj3m_K6OvEApRnRk.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fo5hZiAmD9-vhj3m_K6OvEApRnRk.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fo5hZiAmD9-vhj3m_K6OvEApRnRk.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fo5hZiAmD9-vhj3m_K6OvEApRnRk.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fsb8EZCP4-hn24Mb7hbkxE315HsO.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fsb8EZCP4-hn24Mb7hbkxE315HsO.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fsb8EZCP4-hn24Mb7hbkxE315HsO.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fsb8EZCP4-hn24Mb7hbkxE315HsO.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fr-ErqcFJVwUrlT8pLPLaJSmOgpS.jpg","url_list":["http://p3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-ErqcFJVwUrlT8pLPLaJSmOgpS.jpg.jpeg","http://pb9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-ErqcFJVwUrlT8pLPLaJSmOgpS.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-ErqcFJVwUrlT8pLPLaJSmOgpS.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/Fr-C1S6YSk_ATBdR9NxWeBO4oi-E.jpg","url_list":["http://p9.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-C1S6YSk_ATBdR9NxWeBO4oi-E.jpg.jpeg","http://pb1.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-C1S6YSk_ATBdR9NxWeBO4oi-E.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/Fr-C1S6YSk_ATBdR9NxWeBO4oi-E.jpg.jpeg"],"width":720,"height":720},{"uri":"cmp-ecom-alliance/FjbbHcvDIGbKUjxxCDqWmb1y8SaX.jpg","url_list":["http://p9.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjbbHcvDIGbKUjxxCDqWmb1y8SaX.jpg.jpeg","http://pb1.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjbbHcvDIGbKUjxxCDqWmb1y8SaX.jpg.jpeg","http://pb3.pstatp.com/aweme/720x720/cmp-ecom-alliance/FjbbHcvDIGbKUjxxCDqWmb1y8SaX.jpg.jpeg"],"width":720,"height":720}],"promotion_source":7,"card_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/","ies_category":2,"meta_param":"{\"is_star_atlas\":false}","goods_source":"来自淘宝"}]", "sort_label":"", "statistics":{ "aweme_id":"6789912376708762888", "comment_count":468, "digg_count":6751, "download_count":141, "forward_count":23, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":145, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6789912376708762888", "dont_share_status":-1, "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "review_result":{ "review_status":0 }, "reviewed":1, "self_see":false, "video_hide_search":0, "with_fusion_goods":true, "with_goods":true }, "story_ttl":0, "text_extra":[ { "end":24, "sec_uid":"MS4wLjABAAAAfLsItSD2WiJrsji1g_iZv-it6W2CcvBFkdUwMjTeSD4", "start":16, "type":0, "user_id":"70258503077" }, { "end":34, "hashtag_id":"1636758346583044", "hashtag_name":"这么穿显瘦20斤", "is_commerce":false, "start":25, "type":1 }, { "end":45, "hashtag_id":"1654958136870920", "hashtag_name":"2020鼠年上上签", "is_commerce":false, "start":35, "type":1 } ], "uniqid_position":null, "user_digged":0, "video":{ "animated_cover":{ "uri":"tos-cn-p-0015/aff71e1f6f1c496a938cb1940813786c_1580899676", "url_list":[ "https://p26-dy.byteimg.com/obj/tos-cn-p-0015/aff71e1f6f1c496a938cb1940813786c_1580899676?from=2563711402_large", "https://p29-dy.byteimg.com/obj/tos-cn-p-0015/aff71e1f6f1c496a938cb1940813786c_1580899676?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/aff71e1f6f1c496a938cb1940813786c_1580899676?from=2563711402_large" ] }, "big_thumbs":null, "bit_rate":[ { "bit_rate":1476364, "gear_name":"normal_540", "is_bytevc1":0, "is_h265":0, "play_addr":{ "data_size":2337639, "file_cs":"c:0-15163-8a20", "height":720, "uri":"v0200ff70000bot9qkt1mike03m89rn0", "url_key":"v0200ff70000bot9qkt1mike03m89rn0_h264_540p_1476364", "url_list":[ "http://v95-dy.ixigua.com/46ff7b126230f2dd2d9705c1d564ba13/5f5f96a9/video/tos/cn/tos-cn-ve-15/ed3d524afc414fd5b3c3e03b799f89b6/?a=1128&br=4323&bt=1441&cr=0&cs=0&cv=1&dr=0&ds=6&er=&l=2020091423131701012912923017205465&lr=all&mime_type=video_mp4&qs=0&rc=M3U7NmhsNG48cjMzOmkzM0ApaWRoZTZmZ2VoNzhmO2ZlZ2drNmotaGpxbnFfLS1jLS9zcy9eNi4vNF8wMjUzMWItMC46Yw%3D%3D&vl=&vr=", "http://v6-dy.ixigua.com/ce6ce97ff61b4e16b855254ae7be4dab/5f5f96a9/video/tos/cn/tos-cn-ve-15/ed3d524afc414fd5b3c3e03b799f89b6/?a=1128&br=4323&bt=1441&cr=0&cs=0&cv=1&dr=0&ds=6&er=&l=2020091423131701012912923017205465&lr=all&mime_type=video_mp4&qs=0&rc=M3U7NmhsNG48cjMzOmkzM0ApaWRoZTZmZ2VoNzhmO2ZlZ2drNmotaGpxbnFfLS1jLS9zcy9eNi4vNF8wMjUzMWItMC46Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "quality_type":20 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"tos-cn-p-0015/f3bdc9a9137e41deb84b409c07385619_1580899676", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/f3bdc9a9137e41deb84b409c07385619_1580899676~c5_300x400.jpeg?from=2563711402_large", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/f3bdc9a9137e41deb84b409c07385619_1580899676~c5_300x400.jpeg?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/f3bdc9a9137e41deb84b409c07385619_1580899676~c5_300x400.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":2337639, "height":720, "uri":"v0200ff70000bot9qkt1mike03m89rn0", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "download_suffix_logo_addr":{ "height":720, "uri":"v0200ff70000bot9qkt1mike03m89rn0", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_suffix&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_suffix&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "duration":12667, "dynamic_cover":{ "height":720, "uri":"tos-cn-p-0015/29044707ddaf4a27a6ab69518cfb829d_1580899676", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/29044707ddaf4a27a6ab69518cfb829d_1580899676?from=2563711402_large", "https://p9-dy.byteimg.com/obj/tos-cn-p-0015/29044707ddaf4a27a6ab69518cfb829d_1580899676?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/29044707ddaf4a27a6ab69518cfb829d_1580899676?from=2563711402_large" ], "width":720 }, "has_download_suffix_logo_addr":true, "has_watermark":true, "height":960, "is_bytevc1":0, "is_callback":true, "is_h265":0, "need_set_token":false, "origin_cover":{ "height":720, "uri":"tos-cn-p-0015/0334e9d10d214b5090dce9c941c8e714_1580899676", "url_list":[ "https://p9-dy.byteimg.com/tos-cn-p-0015/0334e9d10d214b5090dce9c941c8e714_1580899676~tplv-dy-360p.jpeg?from=2563711402", "https://p26-dy.byteimg.com/tos-cn-p-0015/0334e9d10d214b5090dce9c941c8e714_1580899676~tplv-dy-360p.jpeg?from=2563711402", "https://p29-dy.byteimg.com/tos-cn-p-0015/0334e9d10d214b5090dce9c941c8e714_1580899676~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":2337639, "file_cs":"c:0-15163-8a20", "height":720, "uri":"v0200ff70000bot9qkt1mike03m89rn0", "url_key":"v0200ff70000bot9qkt1mike03m89rn0_h264_540p_1476364", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "play_addr_lowbr":{ "data_size":2337639, "file_cs":"c:0-15163-8a20", "height":720, "uri":"v0200ff70000bot9qkt1mike03m89rn0", "url_key":"v0200ff70000bot9qkt1mike03m89rn0_h264_540p_1476364", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bot9qkt1mike03m89rn0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "ratio":"540p", "tags":null, "use_static_cover":false, "width":540 }, "video_control":{ "allow_download":true, "allow_duet":true, "allow_dynamic_wallpaper":true, "allow_music":true, "allow_react":true, "allow_stitch":true, "draft_progress_bar":0, "prevent_download_type":0, "share_type":1, "show_progress_bar":0, "timer_status":1 }, "video_labels":null, "video_text":[ ], "vr_type":0, "with_promotional_music":false, "without_watermark":false, "xigua_task":{ "is_xigua_task":false } } ], "similar_list":[ ], "status_code":0 }, "msg":"success"}

November 24, 2020 · 4 min · jiezi

关于大数据:抖音Api带货视频随机推荐

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音Api：带货视频随机举荐申请Apihttp://主机地址/douyin/promotion/feed?token=xxx&cursor=1申请形式GET参数字段类型阐明tokenstring接口受权码cursorint翻页游标，初始为1，第二页则传2，以此类推返回示例{ "code":200, "data":{ "aweme_list":[ { "anchors":null, "author":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"1cb370003ad3d992f6eae", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/1cb370003ad3d992f6eae~c5_168x168.webp?from=4010531038", "https://p29-dy.byteimg.com/img/1cb370003ad3d992f6eae~c5_168x168.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/1cb370003ad3d992f6eae~c5_168x168.webp?from=4010531038" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"1cb370003ad3d992f6eae", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/1cb370003ad3d992f6eae~c5_300x300.webp?from=4010531038", "https://p29-dy.byteimg.com/img/1cb370003ad3d992f6eae~c5_300x300.webp?from=4010531038", "https://p9-dy.byteimg.com/img/1cb370003ad3d992f6eae~c5_300x300.webp?from=4010531038" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"1cb370003ad3d992f6eae", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/1cb370003ad3d992f6eae.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"1cb370003ad3d992f6eae", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/720x720/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/1cb370003ad3d992f6eae.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"1cb370003ad3d992f6eae", "url_list":[ "https://p26-dy.byteimg.com/aweme/100x100/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/1cb370003ad3d992f6eae.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/1cb370003ad3d992f6eae.jpeg?from=4010531038" ], "width":720 }, "avatar_uri":"1cb370003ad3d992f6eae", "aweme_count":0, "bind_phone":"", "birthday":"1985-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":10, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p26-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":0, "fb_expire_time":0, "follow_status":0, "follower_count":0, "follower_status":0, "followers_detail":null, "following_count":0, "gender":1, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":false, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"渝北博涵五金店", "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAATKTK12pS1I9u8M4mz4bX5RplD6BdPc16ZssFE7ANYAQ", "secret":0, "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"1968527078", "show_image_bubble":false, "signature":"每周五~周六8点30分开播解说澳新羊角锤，宏迪卷尺，木工钉包耳，名匠吊线坠，百盛牌劳保手套，3537品牌胶鞋", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":0, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"110523983117", "unique_id":"DD6530", "unique_id_modify_time":1600096458, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":true, "with_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"", "youtube_expire_time":0 }, "author_user_id":110523983117, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6868565570846084352", "aweme_type":0, "bodydance_score":0, "cha_list":null, "challenge_position":null, "city":"500000", "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "commerce_info":{ }, "cover_labels":null, "create_time":1599212547, "desc":"澳新8两直角锤", "desc_language":"zh", "distance":"", "distribute_type":1, "duration":13800, "geofencing":[ ], "geofencing_regions":null, "group_id":"6868565570846084352", "have_dashboard":false, "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_ads":false, "is_fantasy":false, "is_hash_tag":1, "is_pgcshow":false, "is_preview":0, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "item_stitch":0, "label_top_text":null, "long_video":null, "nickname_position":null, "origin_comment_ids":null, "poi_patch_info":{ "item_patch_poi_prompt_mark":0 }, "position":null, "prevent_download":false, "promotion_other_info":{ "recall_reason":"heat" }, "promotions":[ { "clicks":0, "cos_fee":0, "cos_radio":100, "elastic_img":[ { "height":720, "uri":"temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853", "url_list":[ "https://p26-dy.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "elastic_introduction":"", "elastic_title":"绝缘柄8两锤头", "elastic_type":1, "extra":"", "favorited":false, "gid":"3427208925718663648", "h5_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/", "image":{ "height":720, "uri":"temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, "imgs":[ { "height":720, "uri":"temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/fea7287e97e071800f606ec49af59d27e56e6f7cwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/df38b085e2a19e7a511dd5c950192499e505b4edwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/5ef6dc421b2db116c71a94dbd947fa2e9768474dwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853", "url_list":[ "https://p9-dy.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/3c9535bd4f88149fa930b99786b8f631db9e276fwww750-853~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/45e649561f5336a5501db5c3e57697200dac16c6www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "item_type":4, "label":[ ], "market_price":5220, "price":5220, "promotion_id":"3427208925718663648", "promotion_source":4, "rank":101, "rank_url":"https://lianmeng.snssdk.com/assistant/board?title=%E5%A5%BD%E7%89%A9%E6%A6%9C", "sales":304, "title":"澳新工具羊角锤绝缘柄8两木工锤圆头特钢防滑面铁榔头 工地拔钉锤", "title_prefix":"视频同款：", "url":"https://haohuo.jinritemai.com/views/product/item2?id=3427208925718663648&origin_type=3002001000&origin_id=6868565570846084352_3427208925718663648&alkey=1128_110523983117_6868565570846084352_3427208925718663648_010", "user_shop_categories":null, "views":0, "visitor":{ "avatar":[ { "uri":"100x100/3122900003a3fb7d318e7", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3122900003a3fb7d318e7.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3122900003a3fb7d318e7.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/3122900003a3fb7d318e7.jpeg?from=4010531038" ] }, { "uri":"https://p0.pstatp.com/origin/3793/3114521287", "url_list":[ "https://p0.pstatp.com/origin/3793/3114521287" ] }, { "uri":"100x100/2e0ff0003ee7e55bc1db7", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2e0ff0003ee7e55bc1db7.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e0ff0003ee7e55bc1db7.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/2e0ff0003ee7e55bc1db7.jpeg?from=4010531038" ] }, { "uri":"100x100/2f92c000345c03ea41061", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/2f92c000345c03ea41061.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2f92c000345c03ea41061.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2f92c000345c03ea41061.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-i-0813/f990f515dc2246b7800bf707a1e66d8a", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/f990f515dc2246b7800bf707a1e66d8a~c5_100x100.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/f990f515dc2246b7800bf707a1e66d8a~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/f990f515dc2246b7800bf707a1e66d8a~c5_100x100.jpeg?from=4010531038" ] } ], "count":23750 } }, { "clicks":0, "cos_fee":0, "cos_radio":100, "elastic_img":[ { "height":720, "uri":"temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/26824caa436952174a1a6c5285712aa1dbd6345cwww800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/26824caa436952174a1a6c5285712aa1dbd6345cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/26824caa436952174a1a6c5285712aa1dbd6345cwww800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/26824caa436952174a1a6c5285712aa1dbd6345cwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "elastic_introduction":"", "elastic_title":"澳新纤维把方头锤", "elastic_type":1, "extra":"", "favorited":false, "gid":"3426336355867832495", "h5_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/", "image":{ "height":720, "uri":"temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, "imgs":[ { "height":720, "uri":"temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/76674c33a6947b46ed9eec4b75f5bcfeea907f7dwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/c2ba8277fe404a03b3e38c2713e03209a7ba8116www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/Fo4jr4NiUVRe5Kqnmy3RO-4mnObgwww800-800", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/temai/Fo4jr4NiUVRe5Kqnmy3RO-4mnObgwww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/Fo4jr4NiUVRe5Kqnmy3RO-4mnObgwww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/Fo4jr4NiUVRe5Kqnmy3RO-4mnObgwww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/40478a558237ba7ea2626a859449fb3bb15259a5www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800", "url_list":[ "https://p9-dy.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/b7d0bc4d2585cfa008cf75c5546c0e6c227a6758www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "item_type":4, "label":[ ], "market_price":5700, "price":5300, "promotion_id":"3426336355867832495", "promotion_source":4, "rank":101, "rank_url":"https://lianmeng.snssdk.com/assistant/board?title=%E5%A5%BD%E7%89%A9%E6%A6%9C", "sales":53, "title":"澳新工具 羊角锤 木工 方头钉锤防滑榔头碳钢锻造迷你五金铁锤子", "title_prefix":"视频同款：", "url":"https://haohuo.jinritemai.com/views/product/item2?id=3426336355867832495&origin_type=3002001000&origin_id=6868565570846084352_3426336355867832495&alkey=1128_110523983117_6868565570846084352_3426336355867832495_010", "user_shop_categories":null, "views":0, "visitor":{ "avatar":[ { "uri":"100x100/90f3000ed9ceb9b79093", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/90f3000ed9ceb9b79093.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/90f3000ed9ceb9b79093.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/90f3000ed9ceb9b79093.jpeg?from=4010531038" ] }, { "uri":"100x100/2e1d50002f4f7391d28fc", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/2e1d50002f4f7391d28fc.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2e1d50002f4f7391d28fc.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e1d50002f4f7391d28fc.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-i-0813/e53b76fbc2c545599458737407785c31", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/e53b76fbc2c545599458737407785c31~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/e53b76fbc2c545599458737407785c31~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/e53b76fbc2c545599458737407785c31~c5_100x100.jpeg?from=4010531038" ] }, { "uri":"100x100/1b59d0000c372060d1e04", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/1b59d0000c372060d1e04.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/1b59d0000c372060d1e04.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/1b59d0000c372060d1e04.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-i-0813/189ae2a715e24ef2a67005bc81171e75", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/189ae2a715e24ef2a67005bc81171e75~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/189ae2a715e24ef2a67005bc81171e75~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/189ae2a715e24ef2a67005bc81171e75~c5_100x100.jpeg?from=4010531038" ] } ], "count":8085 } }, { "clicks":0, "cos_fee":0, "cos_radio":100, "elastic_img":[ { "height":720, "uri":"temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "elastic_introduction":"", "elastic_title":"圆头直角8两锤头", "elastic_type":1, "extra":"", "favorited":false, "gid":"3426343818516129536", "h5_url":"https://aweme.snssdk.com/falcon/douyin_falcon/business/ad_card/", "image":{ "height":720, "uri":"temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800", "url_list":[ "https://p29-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, "imgs":[ { "height":720, "uri":"temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800", "url_list":[ "https://p26-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/temai/dc398e44f839ae18e7e398f13037c487cf6bb7f3www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/14e8abd75280c3e5be881c0d08b4fd8559207bf9www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/e2913e4c98990a017bacf0d3ff16ba3d3949dd0awww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402", "https://p9-dy.byteimg.com/img/temai/a45e2a7bc029afa36df85732e14b0d781623694awww800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 }, { "height":720, "uri":"temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402", "https://p26-dy.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402", "https://p29-dy.byteimg.com/img/temai/11122a60aadf5f2a9d595ca932ffac37ca2d2914www800-800~c5_720x720.jpeg?from=2563711402" ], "width":720 } ], "item_type":4, "label":[ ], "market_price":5700, "price":5700, "promotion_id":"3426343818516129536", "promotion_source":4, "rank":101, "rank_url":"https://lianmeng.snssdk.com/assistant/board?title=%E5%A5%BD%E7%89%A9%E6%A6%9C", "sales":5, "title":"澳新羊角锤 木工钉锤 圆头防滑直角碳钢五金迷你铁郎头 铁锤子", "title_prefix":"视频同款：", "url":"https://haohuo.jinritemai.com/views/product/item2?id=3426343818516129536&origin_type=3002001000&origin_id=6868565570846084352_3426343818516129536&alkey=1128_110523983117_6868565570846084352_3426343818516129536_010", "user_shop_categories":null, "views":0, "visitor":{ "avatar":[ { "uri":"100x100/2e4970000e920e1a56ec2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e4970000e920e1a56ec2.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2e4970000e920e1a56ec2.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2e4970000e920e1a56ec2.jpeg?from=4010531038" ] }, { "uri":"100x100/93e0001f51ea84265261", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/93e0001f51ea84265261.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/93e0001f51ea84265261.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/93e0001f51ea84265261.jpeg?from=4010531038" ] }, { "uri":"100x100/319f700077ebb21172725", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/319f700077ebb21172725.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/319f700077ebb21172725.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/319f700077ebb21172725.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-i-0813/6ce10215b39049279010961884dd2916", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/6ce10215b39049279010961884dd2916~c5_100x100.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/6ce10215b39049279010961884dd2916~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/6ce10215b39049279010961884dd2916~c5_100x100.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-i-0813/94f416e7033943e8add7b26ea369d596", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/94f416e7033943e8add7b26ea369d596~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/94f416e7033943e8add7b26ea369d596~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/94f416e7033943e8add7b26ea369d596~c5_100x100.jpeg?from=4010531038" ] } ], "count":378 } } ], "rate":12, "region":"CN", "report_action":false, "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"#在抖音，记录美好生活#澳新8两直角锤", "share_link_desc":"澳新8两直角锤 %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"澳新8两直角锤", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6868565570846084352/?region=CN&mid=6863747650169490190&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#澳新8两直角锤" }, "share_url":"https://www.iesdouyin.com/share/video/6868565570846084352/?region=CN&mid=6863747650169490190&u_code=0&titleType=title", "sort_label":"", "statistics":{ "aweme_id":"6868565570846084352", "comment_count":716, "digg_count":2466, "download_count":52, "forward_count":6, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":25, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6868565570846084352", "dont_share_status":-1, "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "review_result":{ "review_status":0 }, "reviewed":1, "self_see":false, "video_hide_search":0, "with_fusion_goods":true, "with_goods":true }, "story_ttl":0, "text_extra":[ ], "uniqid_position":null, "user_digged":0, "video":{ "big_thumbs":null, "bit_rate":[ { "bit_rate":1095134, "gear_name":"normal_540", "is_bytevc1":0, "is_h265":0, "play_addr":{ "data_size":1889107, "file_cs":"c:0-16068-e5ea", "height":720, "uri":"v0300f340000bt90n3tvgjv7bkdgsjtg", "url_key":"v0300f340000bt90n3tvgjv7bkdgsjtg_h264_540p_1095134", "url_list":[ "http://v27-dy.ixigua.com/a4325fe1b57b572e6f2534916a7f18a4/5f5f96e7/video/tos/cn/tos-cn-ve-15/f1b6dae5fd3d4a66976f96cd09a3d615/?a=1128&br=3207&bt=1069&cr=0&cs=0&cv=1&dr=0&ds=6&er=&l=2020091423141801013107414827208470&lr=all&mime_type=video_mp4&qs=0&rc=am1qbjpteTYzdzMzN2kzM0ApZjQ1ZmQ2Ozs2N2VpPDQ1ZGdxcGFfc2RxazZfLS0wLTBzczNjMWIuL2MvNV40Li42Xy86Yw%3D%3D&vl=&vr=", "http://v26-dy.ixigua.com/1675530d1d4c27b4b4951a739ea22403/5f5f96e7/video/tos/cn/tos-cn-ve-15/f1b6dae5fd3d4a66976f96cd09a3d615/?a=1128&br=3207&bt=1069&cr=0&cs=0&cv=1&dr=0&ds=6&er=&l=2020091423141801013107414827208470&lr=all&mime_type=video_mp4&qs=0&rc=am1qbjpteTYzdzMzN2kzM0ApZjQ1ZmQ2Ozs2N2VpPDQ1ZGdxcGFfc2RxazZfLS0wLTBzczNjMWIuL2MvNV40Li42Xy86Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "quality_type":20 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"tos-cn-p-0015/54db4e2a017441e78f8d4ff3d71ccc6d", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/54db4e2a017441e78f8d4ff3d71ccc6d~c5_300x400.jpeg?from=2563711402_large", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/54db4e2a017441e78f8d4ff3d71ccc6d~c5_300x400.jpeg?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/54db4e2a017441e78f8d4ff3d71ccc6d~c5_300x400.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":1889107, "height":720, "uri":"v0300f340000bt90n3tvgjv7bkdgsjtg", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "duration":13800, "dynamic_cover":{ "height":720, "uri":"tos-cn-p-0015/7c40388314ff49068d5367b3c5d609a0_1599212549", "url_list":[ "https://p26-dy.byteimg.com/obj/tos-cn-p-0015/7c40388314ff49068d5367b3c5d609a0_1599212549?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/7c40388314ff49068d5367b3c5d609a0_1599212549?from=2563711402_large", "https://p29-dy.byteimg.com/obj/tos-cn-p-0015/7c40388314ff49068d5367b3c5d609a0_1599212549?from=2563711402_large" ], "width":720 }, "has_watermark":true, "height":1280, "is_bytevc1":0, "is_callback":true, "is_h265":0, "need_set_token":false, "origin_cover":{ "height":720, "uri":"tos-cn-p-0015/3ac3572004f549d8bf82a61cc018d40b_1599212548", "url_list":[ "https://p29-dy.byteimg.com/tos-cn-p-0015/3ac3572004f549d8bf82a61cc018d40b_1599212548~tplv-dy-360p.jpeg?from=2563711402", "https://p1-dy-ipv6.byteimg.com/tos-cn-p-0015/3ac3572004f549d8bf82a61cc018d40b_1599212548~tplv-dy-360p.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/tos-cn-p-0015/3ac3572004f549d8bf82a61cc018d40b_1599212548~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":1889107, "file_cs":"c:0-16068-e5ea", "height":720, "uri":"v0300f340000bt90n3tvgjv7bkdgsjtg", "url_key":"v0300f340000bt90n3tvgjv7bkdgsjtg_h264_540p_1095134", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "play_addr_lowbr":{ "data_size":1889107, "file_cs":"c:0-16068-e5ea", "height":720, "uri":"v0300f340000bt90n3tvgjv7bkdgsjtg", "url_key":"v0300f340000bt90n3tvgjv7bkdgsjtg_h264_540p_1095134", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED", "https://api.amemv.com/aweme/v1/play/?video_id=v0300f340000bt90n3tvgjv7bkdgsjtg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_ECOMMERCE_FEED" ], "width":720 }, "ratio":"540p", "tags":null, "width":720 }, "video_control":{ "allow_download":true, "allow_duet":true, "allow_dynamic_wallpaper":true, "allow_music":true, "allow_react":true, "allow_stitch":true, "draft_progress_bar":0, "prevent_download_type":0, "share_type":1, "show_progress_bar":0, "timer_status":1 }, "video_labels":null, "video_text":[ ], "vr_type":0, "with_promotional_music":false, "without_watermark":false, "xigua_task":{ "is_xigua_task":false } } ], "extra":{ "fatal_item_ids":[ ], "logid":"2020091423141801013107414827208470", "now":1600096458000 }, "has_more":true, "log_pb":{ "impr_id":"2020091423141801013107414827208470" }, "status_code":0 }, "msg":"success"}

November 24, 2020 · 5 min · jiezi

关于大数据:抖音Api带货商品详情

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音Api：带货商品详情申请Apihttp://主机地址/douyin/promotion/detail?token=xxx&pid=61088777146700申请形式GET参数字段类型阐明tokenstring接口受权码pidint商品的promotion_id返回示例{ "code": 200, "data": { "extra": { "fatal_item_ids": [ ], "logid": "202009142312040101440611633128EFDF", "now": 1600096324000 }, "log_pb": { "impr_id": "202009142312040101440611633128EFDF" }, "page_style": { "comment_page_tag_max": 0, "detail_page_stats_show": true, "detail_page_tag_max": 3, "detail_page_tag_show": false }, "promotions": [ { "base_info": { "images": [ { "height": 720, "uri": "cmp-ecom-alliance/FrchgUilgiPUABAlgrhBP7dHpbdM.jpg", "url_list": [ "http://p9.pstatp.com/obj/cmp-ecom-alliance/FrchgUilgiPUABAlgrhBP7dHpbdM.jpg", "http://pb1.pstatp.com/obj/cmp-ecom-alliance/FrchgUilgiPUABAlgrhBP7dHpbdM.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/FrchgUilgiPUABAlgrhBP7dHpbdM.jpg" ], "width": 720 }, { "height": 720, "uri": "cmp-ecom-alliance/FrY8LkT_UB641SxMNh7iEoqBizyt.jpg", "url_list": [ "http://p1.pstatp.com/obj/cmp-ecom-alliance/FrY8LkT_UB641SxMNh7iEoqBizyt.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/FrY8LkT_UB641SxMNh7iEoqBizyt.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/FrY8LkT_UB641SxMNh7iEoqBizyt.jpg" ], "width": 720 }, { "height": 720, "uri": "cmp-ecom-alliance/FiUJxCUkpyatcpQ6K3-7q84_sJNv.jpg", "url_list": [ "http://p3.pstatp.com/obj/cmp-ecom-alliance/FiUJxCUkpyatcpQ6K3-7q84_sJNv.jpg", "http://pb9.pstatp.com/obj/cmp-ecom-alliance/FiUJxCUkpyatcpQ6K3-7q84_sJNv.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/FiUJxCUkpyatcpQ6K3-7q84_sJNv.jpg" ], "width": 720 }, { "height": 720, "uri": "cmp-ecom-alliance/FtTMbV5XjNQzu32mQgi2hcWWhRHt.jpg", "url_list": [ "http://p3.pstatp.com/obj/cmp-ecom-alliance/FtTMbV5XjNQzu32mQgi2hcWWhRHt.jpg", "http://pb9.pstatp.com/obj/cmp-ecom-alliance/FtTMbV5XjNQzu32mQgi2hcWWhRHt.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/FtTMbV5XjNQzu32mQgi2hcWWhRHt.jpg" ], "width": 720 }, { "height": 720, "uri": "cmp-ecom-alliance/Fpte4oGTdlmtk0tai4uUmNCLDPyP.jpg", "url_list": [ "http://p3.pstatp.com/obj/cmp-ecom-alliance/Fpte4oGTdlmtk0tai4uUmNCLDPyP.jpg", "http://pb9.pstatp.com/obj/cmp-ecom-alliance/Fpte4oGTdlmtk0tai4uUmNCLDPyP.jpg", "http://pb3.pstatp.com/obj/cmp-ecom-alliance/Fpte4oGTdlmtk0tai4uUmNCLDPyP.jpg" ], "width": 720 } ], "links": { "h5_url": "https://item.taobao.com/item.htm?id=610887771467" }, "price": { "market_price": 32800, "min_price": 30520 }, "product_id": "610887771467", "promotion_id": "61088777146700", "promotion_source": 7, "promotion_source_text": "商品来自淘宝", "sales": 291, "sold_out": false, "status": 4, "title": "MIUCO设计感复旧系带收腰中长款彩色休闲西装外套女2020春装新款k" }, "entry_info": { }, "extra_info": { "buy_button": { "links": { "h5_url": "https://item.taobao.com/item.htm?id=610887771467" }, "order_status": 0, "text": "去淘宝看看" }, "favorited": false, "pay_type": 0, "shop_id": "0", "visitor_count": 513173 }, "page_coms_config": { "display_gyl": false, "display_want": true, "store_icon": false }, "privilege_info": { "activities": { } } } ], "status_code": 0 }, "msg": "success"}

November 24, 2020 · 1 min · jiezi

关于大数据:抖音Api热门话题推荐

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音Api：热门话题举荐申请Apihttp://主机地址/douyin/feed/funnytags?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "category_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "challenge_info":{ "author":{ "ad_cover_url":null, "can_set_geofencing":null, "cha_list":null, "cover_url":null, "followers_detail":null, "geofencing":null, "homepage_bottom_toast":null, "item_list":null, "need_points":null, "new_story_cover":null, "platform_sync_info":null, "relative_users":null, "type_label":null, "user_tags":null, "white_cover_url":null }, "banner_list":null, "category_cover_info":{ "aweme_id":"6872304402133257487", "cover":{ "uri":"tos-cn-p-0015/367b488536a54648a8ca71f62276b47d", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/367b488536a54648a8ca71f62276b47d~noop.jpeg?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/367b488536a54648a8ca71f62276b47d~noop.jpeg?from=2563711402_large", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/367b488536a54648a8ca71f62276b47d~noop.jpeg?from=2563711402_large" ] }, "dynamic_cover":{ "uri":"tos-cn-p-0015/411a0c5cbf214163a88669531923b1bd_1600083062", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/411a0c5cbf214163a88669531923b1bd_1600083062?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/411a0c5cbf214163a88669531923b1bd_1600083062?from=2563711402_large", "https://p29-dy.byteimg.com/obj/tos-cn-p-0015/411a0c5cbf214163a88669531923b1bd_1600083062?from=2563711402_large" ] } }, "cha_attrs":null, "cha_name":"罔1云歌名起风了", "cid":"1674728436234252", "collect_stat":0, "connect_music":[ ], "desc":"", "extra_attr":{ "is_live":false }, "hashtag_profile":"tos-cn-p-0015/261b04c24ba24d02afc39b762a5567e5", "is_challenge":0, "is_commerce":false, "is_pgcshow":false, "schema":"aweme://aweme/challenge/detail?cid=1674728436234252", "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"我在抖音加入#罔1云歌名起风了 ", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"我在抖音加入#罔1云歌名起风了 ", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/challenge/1674728436234252/?u_code=0", "share_weibo_desc":"我在抖音加入#罔1云歌名起风了 " }, "show_items":null, "sub_type":0, "type":1, "user_count":0, "view_count":0 } } ], "cursor":10, "extra":{ "fatal_item_ids":[ ], "logid":"20200914234019010144040206382C40F3", "now":1600098019000 }, "has_more":1, "log_pb":{ "impr_id":"20200914234019010144040206382C40F3" }, "status_code":0 }, "msg":"success"}

November 23, 2020 · 1 min · jiezi

关于大数据:抖音Api首页视频推荐

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音Api：首页视频举荐申请Apihttp://主机地址/douyin/feed/home?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "aweme_list":[ Object{...}, Object{...}, Object{...}, Object{...}, { "anchors":null, "author":{ "ad_cover_url":null, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"168x168/3125c00060bebf8e29f20", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/3125c00060bebf8e29f20~c5_168x168.webp?from=2563711402", "https://p9-dy.byteimg.com/img/3125c00060bebf8e29f20~c5_168x168.webp?from=2563711402", "https://p1-dy-ipv6.byteimg.com/img/3125c00060bebf8e29f20~c5_168x168.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/3125c00060bebf8e29f20~c5_168x168.jpeg?from=2563711402" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"300x300/3125c00060bebf8e29f20", "url_list":[ "https://p9-dy.byteimg.com/img/3125c00060bebf8e29f20~c5_300x300.webp?from=2563711402", "https://p6-dy-ipv6.byteimg.com/img/3125c00060bebf8e29f20~c5_300x300.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/img/3125c00060bebf8e29f20~c5_300x300.webp?from=2563711402", "https://p9-dy.byteimg.com/img/3125c00060bebf8e29f20~c5_300x300.jpeg?from=2563711402" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"720x720/3125c00060bebf8e29f20", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p1-dy-ipv6.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"100x100/3125c00060bebf8e29f20", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "custom_verify":"", "download_setting":-1, "duet_setting":0, "enterprise_verify_reason":"", "follow_status":0, "followers_detail":null, "geofencing":null, "has_unread_story":false, "hide_location":false, "is_ad_fake":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "location":"", "new_story_cover":null, "nickname":"影帝影视剪辑", "platform_sync_info":null, "prevent_download":false, "region":"CN", "relative_users":null, "room_id":0, "sec_uid":"MS4wLjABAAAAXGn5-LjTlijrFpkOaaysfH7Mr0MPLHAYfySBR7vL3rdgLaNxbmgTurwtq7MzWXnD", "secret":0, "share_info":{ "share_desc":"", "share_qrcode_url":{ "height":720, "uri":"311ee000178c4a5fb8aae", "url_list":[ "https://p6-dy-ipv6.byteimg.com/obj/311ee000178c4a5fb8aae?from=2563711402", "https://p9-dy.byteimg.com/obj/311ee000178c4a5fb8aae?from=2563711402", "https://p26-dy.byteimg.com/obj/311ee000178c4a5fb8aae?from=2563711402" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "short_id":"3568512428", "signature":"感激抖音 感激关注我的敌人们原创剪辑 影视人生学无止境 欢送指导 剧星专页教学：DJWH2021单干宣发：ydyd010101", "story_count":0, "sync_to_toutiao":0, "type_label":null, "uid":"2845133521302685", "unique_id":"ydyd0101", "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":null, "width":720 }, "with_commerce_entry":false }, "author_user_id":2845133521302685, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6870318934051048716", "aweme_type":0, "bodydance_score":0, "cha_list":[ { "author":{ "ad_cover_url":null, "cha_list":null, "cover_url":null, "followers_detail":null, "geofencing":null, "item_list":null, "new_story_cover":null, "platform_sync_info":null, "relative_users":null, "type_label":null }, "cha_attrs":null, "cha_name":"全智贤", "cid":"1631076022005768", "collect_stat":0, "connect_music":null, "desc":"", "is_challenge":0, "is_commerce":false, "is_pgcshow":false, "schema":"aweme://aweme/challenge/detail?cid=1631076022005768", "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"我在抖音加入#全智贤 ", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/challenge/1631076022005768/?u_code=0", "share_weibo_desc":"我在抖音加入#全智贤 " }, "sub_type":0, "type":1, "user_count":0, "view_count":0 } ], "challenge_position":null, "city":"510100", "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "create_time":1599627689, "desc":"这不是个别的牛啊 #全智贤 #夺宝联盟", "desc_language":"zh", "distance":"", "distribute_type":2, "duration":68578, "enable_top_view":true, "follow_up_type":0, "geofencing":null, "geofencing_regions":null, "group_id":"6824454612603391236", "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_ads":false, "is_fantasy":false, "is_hash_tag":1, "is_horizontal":false, "is_pgcshow":false, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "label_top":{ "height":720, "uri":"c150000f34767e2cb56", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c150000f34767e2cb56?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/c150000f34767e2cb56?from=2563711402", "https://p9-dy.byteimg.com/obj/c150000f34767e2cb56?from=2563711402" ], "width":720 }, "label_top_text":null, "long_video":null, "misc_info":"{"ocr_location":"{\"x_max\":0.957078125,\"x_min\":0.28621875,\"y_max\":0.9206944444444444,\"y_min\":0.07386111111111111}"}", "music":{ "album":"", "author":"影帝影视剪辑", "author_deleted":false, "author_position":null, "avatar_large":{ "height":720, "uri":"1080x1080/3125c00060bebf8e29f20", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"720x720/3125c00060bebf8e29f20", "url_list":[ "https://p26-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p9-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"100x100/3125c00060bebf8e29f20", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p9-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "binded_challenge_id":0, "collect_stat":0, "cover_hd":{ "height":720, "uri":"1080x1080/3125c00060bebf8e29f20", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "cover_large":{ "height":720, "uri":"1080x1080/3125c00060bebf8e29f20", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.webp?from=2563711402", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "cover_medium":{ "height":720, "uri":"720x720/3125c00060bebf8e29f20", "url_list":[ "https://p26-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p9-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p29-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/720x720/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "cover_thumb":{ "height":720, "uri":"100x100/3125c00060bebf8e29f20", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p26-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.webp?from=2563711402", "https://p9-dy.byteimg.com/aweme/100x100/3125c00060bebf8e29f20.jpeg?from=2563711402" ], "width":720 }, "duration":68, "end_time":0, "external_song_info":null, "extra":"{"schedule_search_time":0,"review_unshelve_reason":0,"beats":{"merged_beats":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1677418768269315","beats_tracker":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1677418768233476","energy_trace":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1677418757373963","audio_effect_onset":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1677418757404676"},"douyin_beats_info":{},"music_label_id":null,"aggregate_exempt_conf":[],"has_edited":0,"reviewed":0,"hotsoon_review_time":-1}", "id":6870319057602611981, "id_str":"6870319057602611981", "is_author_artist":false, "is_del_video":false, "is_original":false, "is_pgc":false, "is_restricted":false, "is_video_self_see":false, "mid":"6870319057602611981", "mute_share":false, "offline_desc":"", "owner_handle":"ydyd0101", "owner_id":"2845133521302685", "owner_nickname":"影帝影视剪辑", "play_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/6870319058357603079.mp3", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/6870319058357603079.mp3", "http://p1-dy.byteimg.com/obj/ies-music/6870319058357603079.mp3" ], "width":720 }, "position":null, "prevent_download":false, "prevent_item_download_status":0, "preview_end_time":0, "preview_start_time":0, "redirect":false, "schema_url":"", "sec_uid":"MS4wLjABAAAAXGn5-LjTlijrFpkOaaysfH7Mr0MPLHAYfySBR7vL3rdgLaNxbmgTurwtq7MzWXnD", "source_platform":23, "start_time":0, "status":1, "strong_beat_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1677358924516356", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1677358924516356", "http://p1-dy.byteimg.com/obj/ies-music/strong_beat/1677358924516356" ], "width":720 }, "title":"@影帝影视剪辑创作的原声", "unshelve_countries":null, "user_count":0 }, "nickname_position":null, "origin_comment_ids":null, "position":null, "prevent_download":false, "promotions":null, "rate":12, "raw_ad_data":null, "region":"", "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_link_desc":"这不是个别的牛啊 #全智贤 #夺宝联盟 %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"这不是个别的牛啊 #全智贤 #夺宝联盟", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6870318934051048716/?region=CN&mid=6870319057602611981&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#这不是个别的牛啊 #全智贤 #夺宝联盟" }, "share_url":"https://www.iesdouyin.com/share/video/6870318934051048716/?region=CN&mid=6870319057602611981&u_code=0&titleType=title", "sort_label":"_", "star_atlas_info":{ "link_info":{ "avatar_icon":{ "height":720, "uri":"daea0011e9c832dd395c", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/daea0011e9c832dd395c?from=2563711402", "https://p29-dy.byteimg.com/obj/daea0011e9c832dd395c?from=2563711402", "https://p6-dy-ipv6.byteimg.com/obj/daea0011e9c832dd395c?from=2563711402" ], "width":720 }, "id":"98864", "open_url":"", "sub_title":"", "title":"点这里到【韩剧TV】收费看选集", "web_url":"http://hanju.koudaibaobao.com/ch/douyin16" } }, "statistics":{ "aweme_id":"6870318934051048716", "comment_count":19672, "digg_count":1307510, "download_count":15932, "forward_count":6040, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":14870, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6870318934051048716", "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "reviewed":1, "self_see":false, "with_fusion_goods":false, "with_goods":false }, "text_extra":[ { "end":13, "hashtag_id":"1631076022005768", "hashtag_name":"全智贤", "is_commerce":false, "start":9, "type":1 }, { "end":20, "hashtag_id":"1635402797128716", "hashtag_name":"夺宝联盟", "is_commerce":false, "start":15, "type":1 } ], "uniqid_position":null, "user_digged":0, "user_profile_init_info":{ "head_model_score":0.0165863037109375 }, "video":{ "big_thumbs":[ { "duration":68.4, "fext":"jpg", "img_num":68, "img_url":"http://p3-tt.byteimg.com/tos-cn-p-0015/7b0c91cce1a7424e8a63e2503889c37a_1599620811~tplv-obj.image", "img_x_len":10, "img_x_size":240, "img_y_len":7, "img_y_size":136, "interval":10, "uri":"tos-cn-p-0015/7b0c91cce1a7424e8a63e2503889c37a_1599620811" } ], "bit_rate":[ { "bit_rate":1074893, "gear_name":"heaacv2_adapt_lowest_720", "is_h265":1, "play_addr":{ "data_size":9214257, "file_cs":"c:0-45673-9eec", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_bytevc1_720p_1074893", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/cc7a81ffbdea5eb8931e4c07d9dfc4a8/5f5f9d06/video/tos/cn/tos-cn-ve-15/39b37f3ee893418693102363f94b0a69/?a=1128&br=3147&bt=1049&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=15&rc=M2x5bjpteWQ3dzMzN2kzM0ApOTM6Zjk8ZTxnNzxnNzM2aGcvYGNfc2RpYGBfLS0wLTBzc142MmAzYWI0L2ExNjY1LzI6Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/2254f5b849cc7de5e8decd6cdc3a9125/5f5f9d06/video/tos/cn/tos-cn-ve-15/39b37f3ee893418693102363f94b0a69/?a=1128&br=3147&bt=1049&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=15&rc=M2x5bjpteWQ3dzMzN2kzM0ApOTM6Zjk8ZTxnNzxnNzM2aGcvYGNfc2RpYGBfLS0wLTBzc142MmAzYWI0L2ExNjY1LzI6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_FEED&encode_user_tag=heaacv2", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_FEED&encode_user_tag=heaacv2" ], "width":720 }, "play_addr_265":{ "data_size":9214257, "file_cs":"c:0-45673-9eec", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_bytevc1_720p_1074893", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/cc7a81ffbdea5eb8931e4c07d9dfc4a8/5f5f9d06/video/tos/cn/tos-cn-ve-15/39b37f3ee893418693102363f94b0a69/?a=1128&br=3147&bt=1049&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=15&rc=M2x5bjpteWQ3dzMzN2kzM0ApOTM6Zjk8ZTxnNzxnNzM2aGcvYGNfc2RpYGBfLS0wLTBzc142MmAzYWI0L2ExNjY1LzI6Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/2254f5b849cc7de5e8decd6cdc3a9125/5f5f9d06/video/tos/cn/tos-cn-ve-15/39b37f3ee893418693102363f94b0a69/?a=1128&br=3147&bt=1049&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=15&rc=M2x5bjpteWQ3dzMzN2kzM0ApOTM6Zjk8ZTxnNzxnNzM2aGcvYGNfc2RpYGBfLS0wLTBzc142MmAzYWI0L2ExNjY1LzI6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_FEED&encode_user_tag=heaacv2", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_FEED&encode_user_tag=heaacv2" ], "width":720 }, "quality_type":15 }, { "bit_rate":789396, "gear_name":"heaacv2_adapt_540", "is_h265":1, "play_addr":{ "data_size":6766902, "file_cs":"c:0-45673-4626", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_bytevc1_540p_789396", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/2f1a29e2fd0c77ede129e6a3060196f4/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/411bb155f2abfca513d18d12a4ab8e44/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2" ], "width":720 }, "play_addr_265":{ "data_size":6766902, "file_cs":"c:0-45673-4626", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_bytevc1_540p_789396", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/2f1a29e2fd0c77ede129e6a3060196f4/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/411bb155f2abfca513d18d12a4ab8e44/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2" ], "width":720 }, "quality_type":28 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"large/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9", "url_list":[ "http://p3-dy-ipv6.byteimg.com/large/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9.webp?from=2563711402_large", "http://p1-dy-ipv6.byteimg.com/large/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9.webp?from=2563711402_large", "http://p9-dy.byteimg.com/large/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9.webp?from=2563711402_large", "http://p3-dy-ipv6.byteimg.com/large/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":19965500, "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/83ce8a1babe007884b709980578db2bc/5f5f9d06/video/tos/cn/tos-cn-ve-15/4c62f2d7707443c1b3ef6fcfc4c6a059/?a=1128&br=6546&bt=2182&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzo6OWRmN2U2NzY1OzdpaWcvYGNfc2RpYGBfLS0wLTBzc2IyMi9eYy81Yy1gLi9hLy86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/66fb038b17110d56002c15dcd1162841/5f5f9d06/video/tos/cn/tos-cn-ve-15/4c62f2d7707443c1b3ef6fcfc4c6a059/?a=1128&br=6546&bt=2182&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzo6OWRmN2U2NzY1OzdpaWcvYGNfc2RpYGBfLS0wLTBzc2IyMi9eYy81Yy1gLi9hLy86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_FEED", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_FEED" ], "width":720 }, "download_suffix_logo_addr":{ "data_size":19965500, "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/83ce8a1babe007884b709980578db2bc/5f5f9d06/video/tos/cn/tos-cn-ve-15/4c62f2d7707443c1b3ef6fcfc4c6a059/?a=1128&br=6546&bt=2182&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzo6OWRmN2U2NzY1OzdpaWcvYGNfc2RpYGBfLS0wLTBzc2IyMi9eYy81Yy1gLi9hLy86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/66fb038b17110d56002c15dcd1162841/5f5f9d06/video/tos/cn/tos-cn-ve-15/4c62f2d7707443c1b3ef6fcfc4c6a059/?a=1128&br=6546&bt=2182&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzo6OWRmN2U2NzY1OzdpaWcvYGNfc2RpYGBfLS0wLTBzc2IyMi9eYy81Yy1gLi9hLy86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_FEED", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_FEED" ], "width":720 }, "duration":68578, "dynamic_cover":{ "height":720, "uri":"tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9", "url_list":[ "https://p9-dy.byteimg.com/obj/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/obj/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/obj/tos-cn-i-0813/17b33d5d3cc94c70a94e6530a32030c9?from=2563711402_large" ], "width":720 }, "has_download_suffix_logo_addr":true, "has_watermark":true, "height":576, "is_h265":0, "is_long_video":1, "origin_cover":{ "height":720, "uri":"tos-cn-p-0015/24408114e9cf4e9fad2fcea0db5c337d_1599620803", "url_list":[ "https://p29-dy.byteimg.com/tos-cn-p-0015/24408114e9cf4e9fad2fcea0db5c337d_1599620803~tplv-dy-360p.webp?from=2563711402", "https://p9-dy.byteimg.com/tos-cn-p-0015/24408114e9cf4e9fad2fcea0db5c337d_1599620803~tplv-dy-360p.webp?from=2563711402", "https://p3-dy-ipv6.byteimg.com/tos-cn-p-0015/24408114e9cf4e9fad2fcea0db5c337d_1599620803~tplv-dy-360p.webp?from=2563711402", "https://p29-dy.byteimg.com/tos-cn-p-0015/24408114e9cf4e9fad2fcea0db5c337d_1599620803~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":13504880, "file_cs":"c:0-57993-9f37", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_h264_540p_1578064", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/12bce0a5441b6c24ece7740a5b0c404c/5f5f9d06/video/tos/cn/tos-cn-ve-15/dd745c41318c4a9d9f32f0eb518b0b6c/?a=1128&br=4623&bt=1541&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzNpNzxpNTszNzVmNTU2NGcvYGNfc2RpYGBfLS0wLTBzczEyX19jYi5jMi80MmE1YF86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/76ba4adf560ad21eb7ed63ac82e6ed0b/5f5f9d06/video/tos/cn/tos-cn-ve-15/dd745c41318c4a9d9f32f0eb518b0b6c/?a=1128&br=4623&bt=1541&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzNpNzxpNTszNzVmNTU2NGcvYGNfc2RpYGBfLS0wLTBzczEyX19jYi5jMi80MmE1YF86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FEED", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FEED" ], "width":720 }, "play_addr_265":{ "data_size":6766902, "file_cs":"c:0-45673-4626", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_bytevc1_540p_789396", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/2f1a29e2fd0c77ede129e6a3060196f4/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/411bb155f2abfca513d18d12a4ab8e44/5f5f9d06/video/tos/cn/tos-cn-ve-15/2ac60ac8bb644f3a818742aa36f2a267/?a=1128&br=3080&bt=770&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=11&rc=M2x5bjpteWQ3dzMzN2kzM0ApNjlpO2g8Z2Q0Nzg2NWQ6OWcvYGNfc2RpYGBfLS0wLTBzczAvMjU2MjZhXl4xMzAxXl86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_FEED&encode_user_tag=heaacv2" ], "width":720 }, "play_addr_h264":{ "data_size":13504880, "file_cs":"c:0-57993-9f37", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_h264_540p_1578064", "url_list":[ "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_FEED", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_FEED" ], "width":720 }, "play_addr_lowbr":{ "data_size":13504880, "file_cs":"c:0-57993-9f37", "height":720, "uri":"v0300f340000btc4calvgjv7bkfvci20", "url_key":"v0300f340000btc4calvgjv7bkfvci20_h264_540p_1578064", "url_list":[ "http://v26-dy-ab-hot.ixigua.com/12bce0a5441b6c24ece7740a5b0c404c/5f5f9d06/video/tos/cn/tos-cn-ve-15/dd745c41318c4a9d9f32f0eb518b0b6c/?a=1128&br=4623&bt=1541&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzNpNzxpNTszNzVmNTU2NGcvYGNfc2RpYGBfLS0wLTBzczEyX19jYi5jMi80MmE1YF86Yw%3D%3D&vl=&vr=", "http://v3-dy-ab-hot.ixigua.com/76ba4adf560ad21eb7ed63ac82e6ed0b/5f5f9d06/video/tos/cn/tos-cn-ve-15/dd745c41318c4a9d9f32f0eb518b0b6c/?a=1128&br=4623&bt=1541&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=20200914233930010022026038104B5636&lr=all&mime_type=video_mp4&qs=0&rc=M2x5bjpteWQ3dzMzN2kzM0ApOzNpNzxpNTszNzVmNTU2NGcvYGNfc2RpYGBfLS0wLTBzczEyX19jYi5jMi80MmE1YF86Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FEED", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300f340000btc4calvgjv7bkfvci20&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FEED" ], "width":720 }, "ratio":"540p", "video_model":"", "width":1024 }, "video_control":{ "allow_download":true, "allow_duet":false, "allow_dynamic_wallpaper":false, "allow_music":true, "allow_react":false, "draft_progress_bar":1, "prevent_download_type":0, "share_type":1, "show_progress_bar":1, "timer_status":1 }, "video_labels":null, "video_text":null, "vr_type":0, "with_promotional_music":false, "xigua_task":{ "is_xigua_task":false } } ], "disable_adjust_for_cache":false, "enable_re_rank":false, "extra":{ "fatal_item_ids":null, "now":1600097971000 }, "has_more":1, "home_model":1, "log_pb":{ "impr_id":"20200914233930010022026038104B5636" }, "max_cursor":0, "min_cursor":-1, "preload_ads":null, "preload_awemes":null, "refresh_clear":1, "status_code":0 }, "msg":"success"}

November 23, 2020 · 4 min · jiezi

关于大数据:大数据和Hadoop平台介绍

大数据和Hadoop平台介绍定义大数据是指其大小和复杂性无奈通过现有罕用的工具软件，以正当的老本，在可承受的时限内对其进行捕捉、治理和解决的数据集。这些艰难包含数据的支出、存储、搜寻、共享、剖析和可视化。大数据要满足三个基本特征（3V），数据量（volume）、数据多样性（variety）和高速（velocity）。数据量指大数据要解决的数据量个别达到TB甚至PB级别。数据多样性指解决的数据包含结构化数据、非结构化数据（视频、音频、网页）和半结构化数据（xml、html）。高速指大数据必须可能疾速流入并且能失去疾速解决。 大数据倒退背景数据爆炸。随同信息技术的利用，寰球数据量呈几何级数增长。过来几年间的数据总量超过了人类历史上的数据总和。芯片、摄像头、各自传感器遍布世界各个角落，本来不能被感知的事物都能够被监测。软硬件技术的不断进步，也为解决大数据发明的条件。 大数据的应用领域在公共畛域，跨部门提供大数据服务，能大幅缩小检索和解决工夫。进步公共服务的效率。企业通过收集产品在应用中产生的海量数据，进行剖析，能够改善产品性能。大数据能帮忙企业对用户进行更加细化的辨别，并针对用户的不同需要提供个性化的服务。这是营销和危机治理罕用的方法。利用自动化算法反对或代替人工决策。对大数据的剖析能极大改善决策成果，升高危险，并挖掘出其余办法无奈发现的贵重信息。商业模式、产品与服务翻新。Netflix依据大数据分析后果，制作《纸牌屋》。大数据研究课题数据获取问题。包含哪些数据须要保留，哪些数据须要抛弃，如何牢靠的存储咱们须要的数据。数据结构问题。微博博客是没有构造的数据，图像和视频在存储和显示方面具备构造，然而无奈蕴含语义信息进行检索。如果将没有语义的内容转换为结构化的格局，并进行后续解决，是须要面对的另一项挑战。数据集成问题。不同起源数据之间进行关联，能力充分发挥数据的作用。数据分析、组织、抽取和建模如何出现剖析后果科技公司大数据产品谷歌：MapReduceIBM：InfoSphere大数据分析平台SAS：高性能剖析服务器和SAS DataFlux数据流解决引擎EMC：Greenplum 反对海量并行处理Teradata：Aster Data 基于MapReduce，提供了多种统计软件包大数据发展趋势数据资源化。大数据成为企业和社会关注的重要策略资源，并曾经成为大家争相争夺的焦点。与云计算深度联合。大数据离不开云解决，云解决为大数据提供弹性可拓展的根底服务。带动迷信实践的冲破。带动数据挖掘、机器学习、人工智能和数据迷信等相干技术的倒退。大数据处理个别步骤数据的收集。第一个形式是抓取或者爬取。例如搜索引擎就是这么做的：它把网上的所有的信息都下 载到它的数据中心，而后你一搜能力搜进去。第二个形式是推送，有很多终端能够帮我收集数据。比如说小米手环，能够将你每天跑 步的数据，心跳的数据，睡眠的数据都上传到数据中心外面。 数据的传输个别会通过队列形式进行，因为数据量切实是太大了，数据必须通过解决才会有用。可零碎解决不过去，只好排好队，缓缓解决。 数据的存储存储要确保安全，不易失落，高容错性。 数据的解决和剖析存储的数据是原始数据，原始数据多是横七竖八的，有很多垃圾数据在外面，因此须要荡涤和过滤，失去一些高质量的数据。对于高质量的数据，就能够进行剖析，从而对数据进行分类，或者发现数据之间的互相关系，失去常识。 数据的检索和开掘使想要的信息容易被搜寻到。开掘信息之间的互相关系。 开源框架因为大数据的这些特点，针对其收集、传输、存储、解决剖析和检索应用产生了许多开源框架。 |性能|框架| |--|--| |文件存储|Hadoop HDFS、Tachyon、KFS| |离线计算|Hadoop MapReduce、Spark| |流式、实时计算|Storm、Spark Streaming、S4、Heron| |K-V、NOSQL数据库|HBase、Redis、MongoDB| |资源管理|YARN、Mesos| |日志收集|Flume、Scribe、Logstash、Kibana| |音讯零碎|Kafka、StormMQ、ZeroMQ、RabbitMQ| |查问剖析|Hive、Impala、Pig、Presto、Phoenix、SparkSQL、Drill、Flink、Kylin、Druid| |分布式协调服务|Zookeeper| |集群治理与监控|Ambari、Ganglia、Nagios、Cloudera Manager| |数据挖掘、机器学习|Mahout、Spark MLLib| |数据同步|Sqoop| |任务调度|Oozie| 个别大数据平台的框架如下图 Hadoop HDFS和Hadoop MapReduce作为大数据存储和解决的开山鼻祖，大数据平台上都处于外围地位。上面介绍一下两个框架的基本原理。 Hadoop HDFS基本原理HDFS全称Hadoop Distributed File System。HDFS是一个分布式文件系统，能够部署在一个服务器集群上。Java语言开发，能够部署在任何撑持java的机器上。 HDFS有几个基本概念NameNode、DataNode和block。 NameNode负责整个分布式文件系统的元数据管理，也就是文件路径名，数据block的ID以及存储地位等信息。还要记录一些事件，比方哪些节点是集群的一部分，某个block有几份正本等。 DataNode是理论存储文件数据的节点。DataNode会通过心跳和NameNode放弃通信，如果DataNode超时未发送心跳，NameNode就会认为这个DataNode曾经生效，立刻查找这个DataNode上存储的block有哪些，以及这些block还存储在哪些服务器上，随后告诉这些服务器再复制一份block到其余服务器上，保障HDFS存储的block备份数合乎用户设置的数目，即便再有服务器宕机，也不会失落数据。 Block是HDFS中的存储单元，文件被写入HDFS时，会被切分成多个block块，默认的块大小是128MB，每个数据块默认会有三个正本。 数据写入：首先将文件分成多个block，每个block会被写入三个DataNode中，写入哪三个DataNode中是由NameNode指定的，写入实现，NameNode会记录这些信息。同一个文件中不同的block可能会被写入齐全不同的DataNode中。 数据读取：数据读取时按block读取。每一个block时，会从NameNode获取信息，晓得从哪个DataNode中读取，个别是就近准则。所有该文件的block读取实现，形成残缺的文件。 客户端和Datanode是同一个机器：间隔为0 ，示意最近 客户端和Datanode是同一个机架的不同机器 ：间隔为2 ，略微远一点 客户端和Datanode位于同一个数据中心的不同机架上 ：间隔为4，更远一点 Hadoop MapReduce基本原理Hadoop MapReduce是一个分布式计算框架，其中的运算都能够在多个机器上并行进行。使用者只须要实现运算自身的编码，不须要关怀并行计算的底层细节。 MapReduce背地的思维很简略，就是把一些数据通过Map来归类，通过Reduce来把同一类的数据进行解决。Map和reduce的过程都是利用集群的计算能力并行执行的。计算模型的外围是Map和Reduce函数，两个函数由用户自行实现。 把原始大数据集切割成小数据集时，通常小数据集小于等于HDFS的一个block的大小，这样一个小数据集位于一个物理机上，便于本地计算。Map和reduce各自的启动工作数量能够由用户指定。 上图示意一个MapReduce统计单词呈现次数的过程，原始数据宰割为4个子文件，对每个子文件依照用户的Map函数会产生<单词, 呈现次数>的<k2,v2>模式的后果。而后把雷同单词的<k2,v2>组合在一起形成<k2,List(v2)>的模式，作为Reduce函数的输出，雷同的k2肯定分发给雷同的Reduce工作解决，例如单词lorem的所有计算都由第一个Reduce工作来实现。依照这个思维，即便要统计的文件数量上千万个，单词数量有几千个，然而通过MapReduce框架，只有集群机器数量够多，也是能够在可承受工夫内计算实现的。 ...

November 22, 2020 · 1 min · jiezi

关于大数据:抖音榜单Api直播榜

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音榜单：直播榜申请Apihttp://主机地址/douyin/board/live?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "data":{ "ranks":[ { "gap_description":"", "label":"电商", "rank":1, "room":{ "challenge_info":"", "content_label":{ "avg_color":"#524937", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_cover_redPackage_webcast_3_2.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_cover_redPackage_webcast_3_2.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_cover_redPackage_webcast_3_2.png~tplv-obj.image" ], "width":0 }, "cover":{ "avg_color":"#405237", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"b6de001c06cc094d69f4", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/mosaic-legacy/b6de001c06cc094d69f4~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/mosaic-legacy/b6de001c06cc094d69f4~tplv-obj.image" ], "width":0 }, "id":6872311766090140416, "id_str":"6872311766090140416", "title":"忠哥正在直播", "user_count":228388 }, "score":2329697, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authentication_info":{ "authentication_badge":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/authentication_icon.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width":0 }, "custom_verify":"年度巅峰主播十强", "enterprise_verify_reason":"" }, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/b6de001c06cc094d69f4", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/b6de001c06cc094d69f4.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/b6de001c06cc094d69f4", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/720x720/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/b6de001c06cc094d69f4.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/b6de001c06cc094d69f4", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/b6de001c06cc094d69f4.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/b6de001c06cc094d69f4.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_54.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_54.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_54.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "border":{ "icon":{ "avg_color":"", "height":282, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/ranklist_avatar_border_1.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/ranklist_avatar_border_1.png~tplv-obj.png", "http://p3-webcast-dycdn.byteimg.com/img/webcast/ranklist_avatar_border_1.png~tplv-obj.png" ], "width":282 }, "level":0 }, "city":"芜湖", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"asdfghjkl051088", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":16116971, "following_count":3147, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":84064249580, "id_str":"84064249580", "income_share_percent":0, "is_follower":false, "is_following":false, "level":1, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600097347, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"忠哥", "own_room":{ "room_ids":[ 6872311766090141000 ], "room_ids_str":[ "6872311766090140416" ] }, "pay_grade":{ "grade_banner":"", "grade_describe":"间隔55级还差525.6w抖币", "grade_icon_list":[ ], "level":54, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_54.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_54.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_54.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_45_49.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":45744166, "screen_chat_type":0, "this_grade_max_diamond":51000000, "this_grade_min_diamond":39000000, "total_diamond_count":45744166, "upgrade_need_consume":0 }, "pay_score":45744166, "pay_scores":0, "personal_card":{ "avg_color":"", "height":318, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/ranklist_card_1_new.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/ranklist_card_1_new.png~tplv-obj.png", "http://p3-webcast-dycdn.byteimg.com/img/webcast/ranklist_card_1_new.png~tplv-obj.png" ], "width":1125 }, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAAKVZWDB76QBqzxdT3FNvT8QDm4wy6N0JmF1Iuc-YaCEY", "secret":0, "share_qrcode_uri":"552400261c98a1433341", "short_id":183381344, "signature":"做人笨一点，离胜利近一点！我只有这一个号！每晚9点直播", "special_id":"", "status":1, "telephone":"", "ticket_count":1067166842, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":true, "with_fusion_shop_entry":true } }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "top_image_url":"http://sf1-dycdn-tos.pstatp.com/obj/webcast/live_hot_rank.png", "updated_at":1600097359 }, "extra":{ "now":1600097360167 }, "status_code":0 }, "msg":"success"}

November 21, 2020 · 3 min · jiezi

关于大数据:抖音榜单Api人气好物榜

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音榜单：人气好物榜申请Apihttp://主机地址/douyin/board/goods?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code": 200, "data": { "code": 0, "data": { "rank_list": [ { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2e1960006db158c85c09d.jpeg?from=4010531038", "id": 628520101353603, "name": "吃货阿诗", "shop_url": "snssdk1128://goods/shop/?uid=628520101353603" }, "goods": { "commodity_type": 4, "cover": "temai/FtQ4bmyLdVsmHi2u95w8uR_HQimSwww800-800", "detail_url": "", "id": "3434519033431626431", "market_price": 4290, "price": 3690, "product_id": "3434318250152965428", "sales": 29270, "score": 75539, "title": "【7件套】广东晨爽牌肠粉送工具套装家用装蒸盘酱汁专用拉肠粉", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871774430327033096", "item_img": "tos-cn-p-0015/25b39d8a7b6c4d02b018c0137c54cd98_1599959699", "item_type": 4, "item_url": "aweme://aweme/detail/6871774430327033096" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/310ec000271943dfe24f0.jpeg?from=4010531038", "id": 2150298885563934, "name": "骆王宇", "shop_url": "snssdk1128://goods/shop/?uid=2150298885563934" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FuL8Q80_5Chj_9GLo6oG1xMqxUYY.jpg", "detail_url": "", "id": "62704449428700", "market_price": 19800, "price": 12800, "product_id": "627044494287", "sales": 37999, "score": 68374, "title": "【骆王宇举荐】米蓓尔修护固态闪释冻干面膜女熬夜补水舒缓敏感肌", "up_or_down": -1 }, "is_recommended": 0, "item_id": "6871137170531355918", "item_img": "tos-cn-p-0015/392a9fc2c8514501ad7c1e46624a9fc6_1599811314", "item_type": 4, "item_url": "aweme://aweme/detail/6871137170531355918" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0aa0f475c73557a8b9636a8c440373a6~c5_100x100.jpeg?from=4010531038", "id": 102107524550, "name": "GGhouse郭郭定制", "shop_url": "snssdk1128://goods/shop/?uid=102107524550" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fr3YHqQQckfMZkYoEt-oaX31ZBXJ.jpg", "detail_url": "", "id": "62662038108600", "market_price": 15990, "price": 15990, "product_id": "626620381086", "sales": 0, "score": 68317, "title": "郭郭定制秋装2020年新款针织连衣裙女长袖polo裙百搭显瘦中长裙", "up_or_down": -1 }, "is_recommended": 0, "item_id": "6871104250806619405", "item_img": "tos-cn-p-0015/bd7959760dbe45a49a2cca949ddf38e7_1599803631", "item_type": 4, "item_url": "aweme://aweme/detail/6871104250806619405" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/26ea600058d1ab528a0ab.jpeg?from=4010531038", "id": 60734144586, "name": "常熟歌维尚女装", "shop_url": "snssdk1128://goods/shop/?uid=60734144586" }, "goods": { "commodity_type": 4, "cover": "temai/FqwBajNSpzMMy1emDml6MuesPVdjwww800-800", "detail_url": "", "id": "3433918899748490589", "market_price": 10000, "price": 2900, "product_id": "3433918706483391412", "sales": 41000, "score": 31215, "title": "【欢枝】抽绳V领上衣【均码85-145斤】", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6870194522601671950", "item_img": "tos-cn-p-0015/fcd1ce1ccd7747d79910cc57955d04c0_1599591838", "item_type": 4, "item_url": "aweme://aweme/detail/6870194522601671950" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FgkV-nRhxBU6u1hscNilyUultlaT.jpg", "detail_url": "", "id": "61111189038200", "market_price": 17990, "price": 17900, "product_id": "611111890382", "sales": 304111, "score": 30104, "title": "花西子蚕丝蜜粉饼/干粉粉饼定妆控油长久防水遮瑕散粉饼干皮油皮", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6846287662807026951", "item_img": "tos-cn-p-0015/0ce02c55bca64774a6da719bc98b8515_1594025585", "item_type": 4, "item_url": "aweme://aweme/detail/6846287662807026951" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/312380003046df6de1859.jpeg?from=4010531038", "id": 523011370006941, "name": "小盟主（直播中）", "shop_url": "snssdk1128://goods/shop/?uid=523011370006941" }, "goods": { "commodity_type": 4, "cover": "temai/Fo-x23fhxh9KGvzM4U930YXfZTpYwww1000-1000", "detail_url": "", "id": "3424208708526309488", "market_price": 2880, "price": 1980, "product_id": "3423279825354361006", "sales": 59951, "score": 29195, "title": "椒巴客花椒手工锅巴休闲零食大米膨化食品小吃158g*3袋", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871168653899877640", "item_img": "tos-cn-p-0015/00a54bd810074be694afeee26fdb4b06_1599818657", "item_type": 4, "item_url": "aweme://aweme/detail/6871168653899877640" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/31bbd00010b501dba524b.jpeg?from=4010531038", "id": 97361807561, "name": "一只河豚揪", "shop_url": "snssdk1128://goods/shop/?uid=97361807561" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fl5Ahacz0S1UQ0x90_Vnq5ZxRjda.jpg", "detail_url": "", "id": "3298849346171315712", "market_price": 6990, "price": 6900, "product_id": "563422855497", "sales": 303717, "score": 27917, "title": "花西子极细三角眉笔/长久防水防汗初学者不容易脱色晕染超细网红", "up_or_down": 18 }, "is_recommended": 0, "item_id": "6807699850528869640", "item_img": "tos-cn-p-0015/a71dad20efb140ae9ccaa09b435ef102_1585041141", "item_type": 4, "item_url": "aweme://aweme/detail/6807699850528869640" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/1ca7f00020e00069b2ad1.jpeg?from=4010531038", "id": 105859714629, "name": "中源果农", "shop_url": "snssdk1128://goods/shop/?uid=105859714629" }, "goods": { "commodity_type": 6, "cover": "temai/Foddc6av1m1VHvnxooy7kmrfbKYJwww800-800", "detail_url": "", "id": "3432738780191294451", "market_price": 6980, "price": 3750, "product_id": "3432738780191294451", "sales": 35555, "score": 27619, "title": "【中源果农】陕西翠香猕猴桃 20/24/30个装 催熟食用 坏果包赔", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871554613074529551", "item_img": "tos-cn-p-0015/dc019fe5f1b948daa2266a3a6bc014dd_1599908487", "item_type": 4, "item_url": "aweme://aweme/detail/6871554613074529551" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FhenM0zH4lzOjfJoLu3Ps4VGf_7o.jpg", "detail_url": "", "id": "60055810901300", "market_price": 11900, "price": 6990, "product_id": "600558109013", "sales": 295511, "score": 27160, "title": "完满日记白瘦子氨基酸卸妆水女眼唇脸三合一温和深层清洁副品平价", "up_or_down": 23 }, "is_recommended": 0, "item_id": "6864488763788168461", "item_img": "tos-cn-p-0015/e2a9f32091b940648a57d9a027fbe20a_1598263356", "item_type": 4, "item_url": "aweme://aweme/detail/6864488763788168461" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/55280012ec5c73482380.jpeg?from=4010531038", "id": 57843733637, "name": "Uni颖儿", "shop_url": "snssdk1128://goods/shop/?uid=57843733637" }, "goods": { "commodity_type": 6, "cover": "temai/b6f68b2f3d3453c568d6db7998c77decwww800-800", "detail_url": "", "id": "3435009707759278875", "market_price": 5900, "price": 4900, "product_id": "3435009707759278875", "sales": 5365, "score": 27115, "title": "Uni颖儿 尔木萄隔离霜", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6870429486249200911", "item_img": "tos-cn-p-0015/01fe38c273c74d2fb8d872f73a982f05_1599646531", "item_type": 4, "item_url": "aweme://aweme/detail/6870429486249200911" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2d08f000102554f684a0f.jpeg?from=4010531038", "id": 1516972701915476, "name": "阿纯是品质测评家", "shop_url": "snssdk1128://goods/shop/?uid=1516972701915476" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FiWIhxEIb9gNAQbg1uzm4qvP5yeU.jpg", "detail_url": "", "id": "3325384002018382958", "market_price": 12800, "price": 5990, "product_id": "581333547897", "sales": 215200, "score": 24824, "title": "PRAMY/柏瑞美定妆喷雾长久定妆保湿补水控油不脱妆疾速定妆便携带", "up_or_down": 12 }, "is_recommended": 0, "item_id": "6763908165575789827", "item_img": "tos-cn-p-0015/1f985958853b4bbf92327077f5b297ca_1574845107", "item_type": 4, "item_url": "aweme://aweme/detail/6763908165575789827" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fvejhrzd_-Ff9-UUw-zqoJ-MzlWM.jpg", "detail_url": "", "id": "61116446943400", "market_price": 7990, "price": 6900, "product_id": "611164469434", "sales": 203540, "score": 24043, "title": "小奥汀睫毛膏 浓密防水纤长卷翘长久不晕染不脱妆加长女黑白奥丁", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6801773147491175694", "item_img": "tos-cn-p-0015/616ebf9118ca49bcae9229254d99e29e_1583661267", "item_type": 4, "item_url": "aweme://aweme/detail/6801773147491175694" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/fa3d0007be21cbf0c524.jpeg?from=4010531038", "id": 91931984198, "name": "大脸妹张张", "shop_url": "snssdk1128://goods/shop/?uid=91931984198" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FiKjUBRgdRrgPkvjdxWe0WeCU2gH.jpg", "detail_url": "", "id": "3318548473511588839", "market_price": 16800, "price": 13800, "product_id": "559145345945", "sales": 227541, "score": 24023, "title": "日本进口redearth红地球养肤粉底液木本精髓长久遮瑕轻薄裸妆副品", "up_or_down": 21 }, "is_recommended": 0, "item_id": "6855205078920449287", "item_img": "tos-cn-p-0015/3b94134ea1a64d83ac2856b412555fb3_1596101829", "item_type": 4, "item_url": "aweme://aweme/detail/6855205078920449287" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FuoWDRtbpe0cZdJ-Fmphaaa7MyEc.jpg", "detail_url": "", "id": "62503306948500", "market_price": 12900, "price": 12900, "product_id": "625033069485", "sales": 12355, "score": 22008, "title": "潘婷胶囊护发精油小彩蛋显色改善毛躁卷发烫染修复伤害免洗精髓", "up_or_down": -9 }, "is_recommended": 0, "item_id": "6870416621064752388", "item_img": "tos-cn-p-0015/bf23153bb1494d9eb3b7ff3c25bdda82_1599643590", "item_type": 4, "item_url": "aweme://aweme/detail/6870416621064752388" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/30fe80008903733453517.jpeg?from=4010531038", "id": 59034758325, "name": "蓝蓝是个小瘦子（八点直播）", "shop_url": "snssdk1128://goods/shop/?uid=59034758325" }, "goods": { "commodity_type": 4, "cover": "temai/ecb489d35a5c7b74d1bb70d036afaefe4bde3146www800-800", "detail_url": "", "id": "3434785866915166943", "market_price": 15800, "price": 7900, "product_id": "3433905387898846882", "sales": 2980, "score": 21452, "title": "大码女装直筒牛仔裤2020年新款秋季200斤胖妹妹mm遮胯显瘦裤子潮", "up_or_down": -2 }, "is_recommended": 0, "item_id": "6871451403454385416", "item_img": "tos-cn-p-0015/7f9f5e2e40954a208d7db2c63fb8c119_1599884457", "item_type": 4, "item_url": "aweme://aweme/detail/6871451403454385416" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/20aed0004b99dfce0b1c2.jpeg?from=4010531038", "id": 97713144206, "name": "素野君露台园艺", "shop_url": "snssdk1128://goods/shop/?uid=97713144206" }, "goods": { "commodity_type": 4, "cover": "temai/FpFUH69hmywwzGJzWw1FWLwi0SYowww800-800", "detail_url": "", "id": "3435091793165864726", "market_price": 5990, "price": 2990, "product_id": "3434137215209499594", "sales": 8150, "score": 21264, "title": "香雪兰（小苍兰）盆栽", "up_or_down": 13 }, "is_recommended": 0, "item_id": "6871470690894204171", "item_img": "tos-cn-p-0015/8e967eff4c9744c09508196842942571_1599888947", "item_type": 4, "item_url": "aweme://aweme/detail/6871470690894204171" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2f76c000014cd0edaf636.jpeg?from=4010531038", "id": 101441411841, "name": "唐心蛋????", "shop_url": "snssdk1128://goods/shop/?uid=101441411841" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FiempnqtrP9Ac3gjtzsk0GRRqGwm.jpg", "detail_url": "", "id": "61826649540800", "market_price": 23800, "price": 11900, "product_id": "618266495408", "sales": 26893, "score": 20886, "title": "泰国Mistine蜜丝婷蓝盾粉底液干油皮遮瑕长久保湿控油粉底学生女", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6868095266948467979", "item_img": "tos-cn-p-0015/97c99cb54376425b8dd29b081519db55_1599103066", "item_type": 4, "item_url": "aweme://aweme/detail/6868095266948467979" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/3156d0000c6904ec9b268.jpeg?from=4010531038", "id": 93389153804, "name": "老爸评测", "shop_url": "snssdk1128://goods/shop/?uid=93389153804" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FgR5ECr3JCx1cVEPApwKyVQ3yziT.jpg", "detail_url": "", "id": "62479393757500", "market_price": 7900, "price": 7100, "product_id": "624793937575", "sales": 20332, "score": 20685, "title": "工厂发货-老爸评测薄荷海盐清洁面膜100ml清洁毛孔涂抹式泥膜", "up_or_down": -11 }, "is_recommended": 0, "item_id": "6870838136931437831", "item_img": "tos-cn-p-0015/9d1bdd6e4d2e4e9ebfc83f3c27ab2c66_1599741688", "item_type": 4, "item_url": "aweme://aweme/detail/6870838136931437831" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/2d08f000102554f684a0f.jpeg?from=4010531038", "id": 1516972701915476, "name": "阿纯是品质测评家", "shop_url": "snssdk1128://goods/shop/?uid=1516972701915476" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FjQvThvCqEf849X80OTW9dk3szCH.jpg", "detail_url": "", "id": "3311571994923957819", "market_price": 59800, "price": 19800, "product_id": "576223028007", "sales": 81659, "score": 20348, "title": "明星同款 冰希黎幻彩鎏金女士香水长久淡香天然清爽学生少女", "up_or_down": 3 }, "is_recommended": 0, "item_id": "6790556879211728131", "item_img": "tos-cn-p-0015/652f6be6a16f4f7b91740be0467aced6_1581049740", "item_type": 4, "item_url": "aweme://aweme/detail/6790556879211728131" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/31aeb0004dc2dbad7b526.jpeg?from=4010531038", "id": 55979450230, "name": "侯小西", "shop_url": "snssdk1128://goods/shop/?uid=55979450230" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FsT_iRSZfmKLJDILKqJPW7UhG-jY.jpg", "detail_url": "", "id": "61420438580900", "market_price": 92930, "price": 69900, "product_id": "614204385809", "sales": 36744, "score": 19763, "title": "花西子x杜鹃定制西方才子妆奁彩妆套装化妆品全套组合", "up_or_down": -3 }, "is_recommended": 0, "item_id": "6813556445880077583", "item_img": "tos-cn-p-0015/e0b44846f3ca412198bdc5d6de59b4ec_1586404736", "item_type": 4, "item_url": "aweme://aweme/detail/6813556445880077583" }, { "author": { "avatar": "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/1674333200881679~c5_100x100.jpeg?from=4010531038", "id": 98372493335, "name": "哈哈妈妈", "shop_url": "snssdk1128://goods/shop/?uid=98372493335" }, "goods": { "commodity_type": 4, "cover": "temai/48a35f482434728f33ada3fa27e5fedewww610-606", "detail_url": "", "id": "3425970757656806386", "market_price": 59900, "price": 29900, "product_id": "3425958929174271868", "sales": 248, "score": 19649, "title": "【主播福利减50】宝宝摇篮床多功能折叠新生儿儿童床可挪动婴儿床", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6868894333085437184", "item_img": "tos-cn-p-0015/e16ed0b7e7234ff9a7305718ce7be2a4_1599289094", "item_type": 4, "item_url": "aweme://aweme/detail/6868894333085437184" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2f54a000457bb967f265b.jpeg?from=4010531038", "id": 905593202154171, "name": "我是张凯毅", "shop_url": "snssdk1128://goods/shop/?uid=905593202154171" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fn7rgUakzD67ePHDfSYOfyZgsXja.jpg", "detail_url": "", "id": "61357506316600", "market_price": 19900, "price": 13900, "product_id": "613575063166", "sales": 2443, "score": 19505, "title": "Mixx氨基酸洗面奶男女玻色因抗老洁面乳温和控油淡纹洁颜蜜200ml", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871855793575185678", "item_img": "tos-cn-p-0015/e369e000afcc47efa60d15be0de3dfd4_1599978722", "item_type": 4, "item_url": "aweme://aweme/detail/6871855793575185678" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/1b5660003cd57dc8438f3.jpeg?from=4010531038", "id": 94284217764, "name": "Gabby", "shop_url": "snssdk1128://goods/shop/?uid=94284217764" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fqq4jaeCKybdcQYQOWpOMsw7WXs6.jpg", "detail_url": "", "id": "3322068134794539146", "market_price": 12800, "price": 8990, "product_id": "579685049795", "sales": 142790, "score": 19043, "title": "珀莱雅粉底液干皮油皮亲妈长久水润保湿遮瑕控油BB霜女学生平价", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871459380907216143", "item_img": "tos-cn-p-0015/1525806ef0e44d9aaeb8cc3437cfeb27_1599886314", "item_type": 4, "item_url": "aweme://aweme/detail/6871459380907216143" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2de070003a7d51b268494.jpeg?from=4010531038", "id": 3671957135698909, "name": "小草的低卡零食屋", "shop_url": "snssdk1128://goods/shop/?uid=3671957135698909" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fu6iv986_jeRgCkRmuY_LJysBqkG.jpg", "detail_url": "", "id": "61975346188200", "market_price": 9990, "price": 8990, "product_id": "619753461882", "sales": 21142, "score": 18970, "title": "薄荷健康网红轻卡零食大礼包女低零食小吃休闲食品脂解馋控卡", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6870471859356421389", "item_img": "tos-cn-p-0015/10caa1d2ca75436fac23a5ffd602e3a5_1599656483", "item_type": 4, "item_url": "aweme://aweme/detail/6870471859356421389" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FjHJNnDnaOM1qeiSldZu_GITbTS4.jpg", "detail_url": "", "id": "60100911108800", "market_price": 22900, "price": 9900, "product_id": "601009111088", "sales": 136805, "score": 18800, "title": "膜法世家纱布修护面膜10片补水保湿水杨酸控油淡痘印女男魔法世家", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6867078089420066062", "item_img": "tos-cn-p-0015/1b1536b0fd474df0a503c2e96bb41236_1598866241", "item_type": 4, "item_url": "aweme://aweme/detail/6867078089420066062" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FgGnpRbQOuGvR91LXD4PrBIGORzb.jpg", "detail_url": "", "id": "60122318747600", "market_price": 13900, "price": 7990, "product_id": "601223187476", "sales": 119099, "score": 18761, "title": "完满日记金色散粉蜜粉饼定妆粉长久控油防水防汗空气蜜粉三丽鸥", "up_or_down": 16 }, "is_recommended": 0, "item_id": "6828023437299125516", "item_img": "tos-cn-p-0015/e8a087ce62dd448bb25572b23d59d5dd_1589773143", "item_type": 4, "item_url": "aweme://aweme/detail/6828023437299125516" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3136b000b9ca4e7d26cdf.jpeg?from=4010531038", "id": 103429813472, "name": "老宋的微醺23点", "shop_url": "snssdk1128://goods/shop/?uid=103429813472" }, "goods": { "commodity_type": 4, "cover": "temai/47761068e6b078ca704912f77502f253www800-800", "detail_url": "", "id": "3425901610688249759", "market_price": 15000, "price": 8400, "product_id": "3421505481997430330", "sales": 7280, "score": 18667, "title": "【青岛啤酒】白啤11度 焕新包装 日期陈腐 500ml*12听", "up_or_down": -9 }, "is_recommended": 0, "item_id": "6871489674897116424", "item_img": "tos-cn-p-0015/2b7653e35aa9474ca2c71a62e16ce1eb_1599893400", "item_type": 4, "item_url": "aweme://aweme/detail/6871489674897116424" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/31b0b0003211ec5acb246.jpeg?from=4010531038", "id": 56819687816, "name": "哦王小明(9月27号下午4点直播)", "shop_url": "snssdk1128://goods/shop/?uid=56819687816" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FifpzQDe8dAjsM_xv24h_bAPxr6a.jpg", "detail_url": "", "id": "59760292257800", "market_price": 20900, "price": 9900, "product_id": "597602922578", "sales": 22620, "score": 18494, "title": "韩国Medicube乐得遮瑕液针管修复笔膏棒美蒂秋芙官网脸部修容神器", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6745379879673548043", "item_img": "tos-cn-p-0015/87f83fc076634164aaeb3a9ae5b4aae6", "item_type": 4, "item_url": "aweme://aweme/detail/6745379879673548043" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/313cd00025f648fc91dd5.jpeg?from=4010531038", "id": 99836084682, "name": "大P", "shop_url": "snssdk1128://goods/shop/?uid=99836084682" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FlHlK4TgLind-a7_E5me-YjEbcOQ.jpg", "detail_url": "", "id": "62037211800000", "market_price": 999900, "price": 999900, "product_id": "620372118000", "sales": 0, "score": 17318, "title": "【 9/15 20:00 NEW 喜爱珍藏加购】Plastic tree 新品汇合页", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871179927291448590", "item_img": "tos-cn-p-0015/1e6fdba3cb2b4c32995e0e7308ece86d_1599821268", "item_type": 4, "item_url": "aweme://aweme/detail/6871179927291448590" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/31549000d07ea979ba97b.jpeg?from=4010531038", "id": 71515824773, "name": "橙子小厨", "shop_url": "snssdk1128://goods/shop/?uid=71515824773" }, "goods": { "commodity_type": 4, "cover": "temai/FtRNxIGNomnbTGfQkdf1aU8oEoMEwww800-800", "detail_url": "", "id": "3430208748084456683", "market_price": 16900, "price": 5900, "product_id": "3430200248444808557", "sales": 101412, "score": 17073, "title": "【美之扣】电动绞蒜器家用手动小型操持机打拉切压蒜大蒜搅蒜器", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6865161334309260559", "item_img": "tos-cn-p-0015/70ad09f24ffc4c40a7c0a976a112dda9_1598419937", "item_type": 4, "item_url": "aweme://aweme/detail/6865161334309260559" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/1674333200881679~c5_100x100.jpeg?from=4010531038", "id": 98372493335, "name": "哈哈妈妈", "shop_url": "snssdk1128://goods/shop/?uid=98372493335" }, "goods": { "commodity_type": 4, "cover": "temai/FpMDP4XdDe7EBLR4qcvWKNBBpkWZwww800-800", "detail_url": "", "id": "3434439411255905663", "market_price": 6990, "price": 2990, "product_id": "3434439247921305926", "sales": 2720, "score": 16950, "title": "【主播福利减5元】卡通椅背多功能后座汽车餐盘车载收纳储物盒", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871410895738686735", "item_img": "tos-cn-p-0015/944c4b9dc5cf4fe099f07bf2c2200eb8_1599875025", "item_type": 4, "item_url": "aweme://aweme/detail/6871410895738686735" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/310ec000271943dfe24f0.jpeg?from=4010531038", "id": 2150298885563934, "name": "骆王宇", "shop_url": "snssdk1128://goods/shop/?uid=2150298885563934" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fi1M-H_7gDgWzd0y4la2sITfXDcH.jpg", "detail_url": "", "id": "62572257754600", "market_price": 36000, "price": 36000, "product_id": "625722577546", "sales": 4582, "score": 16731, "title": "【骆王宇专属】UNISKIN优时颜#6.3抗糖美白精髓祛黄改善暗沉", "up_or_down": -16 }, "is_recommended": 0, "item_id": "6868578564632071437", "item_img": "tos-cn-p-0015/0adca255b39a4b46992ce10e60121d27_1599215595", "item_type": 4, "item_url": "aweme://aweme/detail/6868578564632071437" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/1b56b0004b5d1d8efeb94.jpeg?from=4010531038", "id": 24883947010, "name": "广式老吴", "shop_url": "snssdk1128://goods/shop/?uid=24883947010" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fh9j_RUlaUWI3MddYtP8jerHG4tb.jpg", "detail_url": "", "id": "61601333551600", "market_price": 18900, "price": 18900, "product_id": "616013335516", "sales": 69764, "score": 16710, "title": "美宝莲旗舰店SuperStay巨持妆粉底液遮瑕控油长久女防水防汗副品", "up_or_down": 5 }, "is_recommended": 0, "item_id": "6853356286948527360", "item_img": "tos-cn-p-0015/ca2647233f774911b93ad6af6f0c3c2b_1595671360", "item_type": 4, "item_url": "aweme://aweme/detail/6853356286948527360" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/ca81add7df7c947c786f5fbd1f0fbcbb~c5_100x100.jpeg?from=4010531038", "id": 75852011344, "name": "兰普兰", "shop_url": "snssdk1128://goods/shop/?uid=75852011344" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FlT6mBk0sS8IyCq05QzkdSebACgd.jpg", "detail_url": "", "id": "61304446364500", "market_price": 16900, "price": 9990, "product_id": "613044463645", "sales": 77595, "score": 16709, "title": "【王一博代言】完子心选3+1神经酰胺面膜贴片补水保湿舒缓修护", "up_or_down": -1 }, "is_recommended": 0, "item_id": "6865179006275292430", "item_img": "tos-cn-p-0015/f9e509e412a94b2a994a3723c90ba0ad_1598424079", "item_type": 4, "item_url": "aweme://aweme/detail/6865179006275292430" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/aweme/100x100/20acb000345aae2a8c11e.jpeg?from=4010531038", "id": 101161791994, "name": "主编的神思", "shop_url": "snssdk1128://goods/shop/?uid=101161791994" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FhI44NzDrNdcfph62p0pHLslpmRq.jpg", "detail_url": "", "id": "3317429891583065777", "market_price": 24800, "price": 11990, "product_id": "4359111383", "sales": 84043, "score": 16061, "title": "膜法世家绿豆泥面膜美白清洁毛孔淡痘印去黑头涂抹式泥膜魔法世家", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6863053288233831688", "item_img": "tos-cn-p-0015/f259e1a18f824c17a0d0d189894f13da_1597929139", "item_type": 4, "item_url": "aweme://aweme/detail/6863053288233831688" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2ce1f0004c79ddc371cf5.jpeg?from=4010531038", "id": 68027072858, "name": "婕婕家里有宝藏啊", "shop_url": "snssdk1128://goods/shop/?uid=68027072858" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FvO8UW66HzUC6LJlAWi0a1Pke-U2.jpg", "detail_url": "", "id": "61670884590900", "market_price": 29900, "price": 10900, "product_id": "616708845909", "sales": 51, "score": 15990, "title": "几光感应灯定制礼盒专属款送礼无线感应全屋智能灯光多场景组合套装", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871622667716365568", "item_img": "tos-cn-p-0015/16c40c0151ba4ba18631b64f3da8a6dc_1599924333", "item_type": 4, "item_url": "aweme://aweme/detail/6871622667716365568" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/1b5450005c99f4e066be3.jpeg?from=4010531038", "id": 98704396690, "name": "园艺优享家", "shop_url": "snssdk1128://goods/shop/?uid=98704396690" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FiBrjDkZpvhKeiOSl1iyJVTR7zCg.jpg", "detail_url": "", "id": "61959824282500", "market_price": 338000, "price": 338000, "product_id": "619598242825", "sales": 4, "score": 15918, "title": "家用湿垃圾处理器厨余粉碎机厨房垃圾生物降解发酵菌种有机肥", "up_or_down": -25 }, "is_recommended": 0, "item_id": "6871179328731008269", "item_img": "tos-cn-p-0015/b4b425d947b34721be7596089828d40a_1599821111", "item_type": 4, "item_url": "aweme://aweme/detail/6871179328731008269" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/2f78a00006acde4e17db8.jpeg?from=4010531038", "id": 329449466757675, "name": "隔壁小吴", "shop_url": "snssdk1128://goods/shop/?uid=329449466757675" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fh-8ZkEgWQCLXYnDoIU-RucGH_b4.jpg", "detail_url": "", "id": "62212992052600", "market_price": 13900, "price": 13900, "product_id": "622129920526", "sales": 2028, "score": 15372, "title": "【全系15款】天然实验室blings小众香不撞香男女长久鸡尾酒淡香水", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871789643382181132", "item_img": "tos-cn-p-0015/a5567030291f4cadb4bbc52721274d3a_1599963252", "item_type": 4, "item_url": "aweme://aweme/detail/6871789643382181132" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/18bbe00046eafa5c2b06e.jpeg?from=4010531038", "id": 100016570964, "name": "赶海小章", "shop_url": "snssdk1128://goods/shop/?uid=100016570964" }, "goods": { "commodity_type": 4, "cover": "temai/FuLvJj8jhe6jbu4azT5E3qL53I-bwww800-800", "detail_url": "", "id": "3433729614206340847", "market_price": 3900, "price": 1990, "product_id": "3433726455157266428", "sales": 30650, "score": 15139, "title": "【本地举荐】山东日照发货盐渍裙带菜带箱5斤19.9", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6870822721203358991", "item_img": "tos-cn-p-0015/f468a510249e4b9dbc2a817641467685_1599738080", "item_type": 4, "item_url": "aweme://aweme/detail/6870822721203358991" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/3136b000b9ca4e7d26cdf.jpeg?from=4010531038", "id": 103429813472, "name": "老宋的微醺23点", "shop_url": "snssdk1128://goods/shop/?uid=103429813472" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FlEkhgxbSbCDpB3iWoEGp-7Sej7_.png", "detail_url": "", "id": "53891101701800", "market_price": 41900, "price": 26500, "product_id": "538911017018", "sales": 3373, "score": 15123, "title": "chivas芝华士12年苏格兰和谐威士忌500ml整箱组合进口洋酒烈酒", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871846773955104014", "item_img": "tos-cn-p-0015/7c04283248d44d75a270aac9620b9d3c_1599976541", "item_type": 4, "item_url": "aweme://aweme/detail/6871846773955104014" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/1e0ba00035e25af8fe7d1.jpeg?from=4010531038", "id": 72319562662, "name": "林剑霄", "shop_url": "snssdk1128://goods/shop/?uid=72319562662" }, "goods": { "commodity_type": 8, "cover": "cmp-ecom-alliance/FodGbNXL1bx0itzcPcH6YZ_Tr3DL.jpg", "detail_url": "", "id": "3434786476273092135", "market_price": 1249900, "price": 1249900, "product_id": "100015073636", "sales": 2, "score": 15049, "title": "摩托罗拉 motorola razr 5G 刀锋折叠屏手机 双模5G全网通 超薄无缝无折痕+大双屏 4800万超强自拍 8GB+256GB 锋雅黑", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871878305075809543", "item_img": "tos-cn-p-0015/6e77c20fded24d9898b507231cd7f4bc_1599983864", "item_type": 4, "item_url": "aweme://aweme/detail/6871878305075809543" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/faed000943aed0948e6f.jpeg?from=4010531038", "id": 92440704622, "name": "零青子", "shop_url": "snssdk1128://goods/shop/?uid=92440704622" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FrYAN_R7trWUkq3GKkGpaoj7YO_P.jpg", "detail_url": "", "id": "62554581384900", "market_price": 5800, "price": 2900, "product_id": "625545813849", "sales": 354, "score": 14980, "title": "劲合明制汉服松蝶之恋原创副品立领齐腰褶裙冬季汉服全套中国风", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6867837938466655491", "item_img": "tos-cn-p-0015/937c17f15e964c6285c1b0ba3b907b7c_1599043132", "item_type": 4, "item_url": "aweme://aweme/detail/6867837938466655491" }, { "author": { "avatar": "https://p3-dy-ipv6.byteimg.com/img/mosaic-legacy/1b57e00061bac6496c562~c5_100x100.jpeg?from=4010531038", "id": 65769625996, "name": "吉祥三宝", "shop_url": "snssdk1128://goods/shop/?uid=65769625996" }, "goods": { "commodity_type": 4, "cover": "temai/FnJiwBaP-yUuJWXExvNxKCmZ16fWwww800-800", "detail_url": "", "id": "3426332720320646697", "market_price": 7000, "price": 1980, "product_id": "3425585956479192124", "sales": 43860, "score": 14876, "title": "瑜伽八字拉力绳", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6870090015137975567", "item_img": "tos-cn-p-0015/aac7aa408e1647208eb5d94c8355d316_1599567486", "item_type": 4, "item_url": "aweme://aweme/detail/6870090015137975567" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2dfd900044cec21a65c11.jpeg?from=4010531038", "id": 81793710243, "name": "潘雨润 9.16苗条专场", "shop_url": "snssdk1128://goods/shop/?uid=81793710243" }, "goods": { "commodity_type": 4, "cover": "temai/FuQ2DXZxP-AdKc0mpqIpdQ0ns7Mtwww800-800", "detail_url": "", "id": "3434051607896176757", "market_price": 17990, "price": 14990, "product_id": "3434051236406689126", "sales": 2160, "score": 14671, "title": "【拍立减】凡士林(Vaseline) 维他亮肤烟酰胺流光身材乳180g", "up_or_down": -8 }, "is_recommended": 0, "item_id": "6871489010112449805", "item_img": "tos-cn-p-0015/f7d3674a16fb4d718f7c874dce5eb095_1599893244", "item_type": 4, "item_url": "aweme://aweme/detail/6871489010112449805" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/facd000b12ec36349082.jpeg?from=4010531038", "id": 56663252872, "name": "小小莎老师", "shop_url": "snssdk1128://goods/shop/?uid=56663252872" }, "goods": { "commodity_type": 4, "cover": "temai/2a321c4385d041fe8a6bbb22d1a333b7www800-800", "detail_url": "", "id": "3435546887825005663", "market_price": 35000, "price": 35000, "product_id": "3435543157704669546", "sales": 2545, "score": 14660, "title": "【Ｄ ｉ ｏ ｒ】口红９９９滋润 ９９９哑光 ８８８（3.5g）", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871944724853296391", "item_img": "tos-cn-p-0015/b2be292e5db243d7a7090e9f0d689987_1599999317", "item_type": 4, "item_url": "aweme://aweme/detail/6871944724853296391" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/314ef000106b341e9d9e5.jpeg?from=4010531038", "id": 60282990510, "name": "张大碗子", "shop_url": "snssdk1128://goods/shop/?uid=60282990510" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FlDqYGMo97VoEP9vq-6SFC8NC--p.jpg", "detail_url": "", "id": "62378289521800", "market_price": 29900, "price": 17900, "product_id": "623782895218", "sales": 7060, "score": 14633, "title": "旁氏虾滑爆水睡眠面膜虾青素焕亮紧致补水淡纹菁妍赋活微囊面膜", "up_or_down": -20 }, "is_recommended": 0, "item_id": "6866396280793451791", "item_img": "tos-cn-p-0015/7436e485253a47d684d82f0eb7c5e2d0_1598707469", "item_type": 4, "item_url": "aweme://aweme/detail/6866396280793451791" }, { "author": { "avatar": "https://p6-dy-ipv6.byteimg.com/aweme/100x100/20acb0004760d0cedcdcd.jpeg?from=4010531038", "id": 60579555802, "name": "lovemimius游鹿鹿", "shop_url": "snssdk1128://goods/shop/?uid=60579555802" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FmoWUwBT3oGs5u9liP8n_InYVzs4.jpg", "detail_url": "", "id": "62485126476500", "market_price": 9900, "price": 9900, "product_id": "624851264765", "sales": 0, "score": 14330, "title": "mimius 8月25日上新合辑 下滑至详情页查看新品 提前珍藏加购...", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6864394955176037647", "item_img": "tos-cn-p-0015/b44438cd11574428936843e55daf06d3_1598241501", "item_type": 4, "item_url": "aweme://aweme/detail/6864394955176037647" }, { "author": { "avatar": "https://p26-dy.byteimg.com/aweme/100x100/315d50000843eb0c8b280.jpeg?from=4010531038", "id": 64707948091, "name": "猪猪芳♥️", "shop_url": "snssdk1128://goods/shop/?uid=64707948091" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/FiVoraJX5eUccqmmeI13znjj7ThK.jpg", "detail_url": "", "id": "60565315699100", "market_price": 12800, "price": 1590, "product_id": "605653156991", "sales": 971, "score": 14015, "title": "夏季棉拖鞋女家居家用月子室内保暖厚底防滑毛绒可恶卡通棉拖男冬", "up_or_down": 0 }, "is_recommended": 0, "item_id": "6871815448506207491", "item_img": "tos-cn-p-0015/49ed66ea4e834e9697c2da86c4560a40_1599969220", "item_type": 4, "item_url": "aweme://aweme/detail/6871815448506207491" }, { "author": { "avatar": "https://p9-dy.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "id": 2326200557505672, "name": "陈彦妃", "shop_url": "snssdk1128://goods/shop/?uid=2326200557505672" }, "goods": { "commodity_type": 7, "cover": "cmp-ecom-alliance/Fqjz3e1ELZiUrbxXZxPJIQUGUEym.jpg", "detail_url": "", "id": "61228863206400", "market_price": 13990, "price": 6990, "product_id": "612288632064", "sales": 39846, "score": 13666, "title": "李施德林进口温和樱花果味漱口水蜜桃青柠椰香女士学生清爽漱口液", "up_or_down": -9 }, "is_recommended": 0, "item_id": "6869315887803927815", "item_img": "tos-cn-p-0015/a840e917fd6143f9b2a8821dcaf61988_1599387323", "item_type": 4, "item_url": "aweme://aweme/detail/6869315887803927815" }, { "author": { "avatar": "https://p29-dy.byteimg.com/aweme/100x100/30e2c0006cdc6d6495bef.jpeg?from=4010531038", "id": 96106104768, "name": "年糕妈妈挑辅食", "shop_url": "snssdk1128://goods/shop/?uid=96106104768" }, "goods": { "commodity_type": 4, "cover": "temai/f1c89c3f90dfed402c2cb76afa473e72www800-800", "detail_url": "", "id": "3435584584752978871", "market_price": 9800, "price": 8800, "product_id": "3435547611527034939", "sales": 76, "score": 13527, "title": "小面包幼儿护脚学步鞋", "up_or_down": -22 }, "is_recommended": 0, "item_id": "6871550527449173260", "item_img": "tos-cn-p-0015/48b9a743e8614ffaa93a85108b3cb944_1599907572", "item_type": 4, "item_url": "aweme://aweme/detail/6871550527449173260" } ], "special": null, "total": 50, "update_time": "更新于: 9月14日 12:00" }, "error": false, "message": "success" }, "msg": "success"}

November 21, 2020 · 12 min · jiezi

关于大数据:抖音榜单Api热点榜

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音榜单：热点榜申请Apihttp://主机地址/douyin/board/hot?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code": 200, "data": { "ad_search_list": null, "data": { "active_time": "2020-09-14 23:20:13", "recommend_list": null, "share_info": { "share_link_desc": "我在看抖音热榜，发现最火的内容，赶快来看！戳这里>>", "share_title": "我在看抖音热榜，发现最火的内容，赶快来看！", "share_url": "https://www.iesdouyin.com/share/billboard/?id=0" }, "trending_desc": "实时回升热点", "trending_list": [ { "group_id": "6871001533455996173", "label": 0, "related_words": null, "sentence_id": "0xc04d280e90", "video_count": 1, "word": "美警察追捕搞错地址砸错门", "word_cover": { "uri": "tos-cn-p-0015/ce4cba031210468f95bb6a3c9f192193_1600067077", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/ce4cba031210468f95bb6a3c9f192193_1600067077~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ce4cba031210468f95bb6a3c9f192193_1600067077~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/ce4cba031210468f95bb6a3c9f192193_1600067077~noop.jpeg?from=3218412987" ] }, "word_type": 3 }, { "group_id": "6870862304994874632", "label": 0, "related_words": null, "sentence_id": "0xc04d280f20", "video_count": 2, "word": "女子善意救济被困房车反遭回绝", "word_cover": { "uri": "tos-cn-p-0015/bc0610a7f6934b5f92575ca90a129338", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/bc0610a7f6934b5f92575ca90a129338~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/bc0610a7f6934b5f92575ca90a129338~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/bc0610a7f6934b5f92575ca90a129338~noop.jpeg?from=3218412987" ] }, "word_type": 3 }, { "group_id": "6870335832144712972", "label": 0, "related_words": null, "sentence_id": "0xc04d280fb0", "video_count": 1, "word": "这就是街舞3决赛夜神秘嘉宾", "word_cover": { "uri": "tos-cn-p-0015/4ded911d77ff4072855bbd2698931c33", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/4ded911d77ff4072855bbd2698931c33~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/4ded911d77ff4072855bbd2698931c33~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/4ded911d77ff4072855bbd2698931c33~noop.jpeg?from=3218412987" ] }, "word_type": 3 }, { "group_id": "6870978388007621901", "label": 0, "related_words": null, "sentence_id": "0xc04d281040", "video_count": 1, "word": "近1000家景区履行收费打折政策", "word_cover": { "uri": "tos-cn-p-0015/2ec676a6778441a0aa84b3b9ed97f38e", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/2ec676a6778441a0aa84b3b9ed97f38e~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/2ec676a6778441a0aa84b3b9ed97f38e~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/2ec676a6778441a0aa84b3b9ed97f38e~noop.jpeg?from=3218412987" ] }, "word_type": 3 }, { "group_id": "6870948419101463816", "label": 0, "related_words": null, "sentence_id": "0xc04d2810d0", "video_count": 1, "word": "焦作举办第三季度消防比武比赛", "word_cover": { "uri": "tos-cn-p-0015/9cbc76a4e79a4df5ae47390d68a61367_1600069460", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/9cbc76a4e79a4df5ae47390d68a61367_1600069460~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/9cbc76a4e79a4df5ae47390d68a61367_1600069460~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/9cbc76a4e79a4df5ae47390d68a61367_1600069460~noop.jpeg?from=3218412987" ] }, "word_type": 3 } ], "word_list": [ { "can_extend_detail": false, "challenge_id": "", "event_time": 1599993150, "group_id": "6870421703589549319", "hot_value": 8782523, "label": 5, "position": 1, "related_words": null, "sentence_id": "123223", "video_count": 3, "word": "李心艾回应胖了", "word_cover": { "uri": "tos-cn-p-0015/7004540786d54652932bd083ceaf5048_1599992729", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/7004540786d54652932bd083ceaf5048_1599992729~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/7004540786d54652932bd083ceaf5048_1599992729~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/7004540786d54652932bd083ceaf5048_1599992729~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600073839, "group_id": "6727600448598971661", "hot_value": 8671307, "label": 0, "position": 2, "related_words": null, "sentence_id": "123795", "video_count": 4, "word": "我喜爱你定档", "word_cover": { "uri": "tos-cn-p-0015/a74429fb1595415182651b508ea4a3ff", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/a74429fb1595415182651b508ea4a3ff~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/a74429fb1595415182651b508ea4a3ff~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/a74429fb1595415182651b508ea4a3ff~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600052975, "group_id": "6860030767771178248", "hot_value": 7701067, "label": 3, "position": 3, "related_words": null, "sentence_id": "123319", "video_count": 12, "word": "首部抗疫题材电视剧", "word_cover": { "uri": "tos-cn-p-0015/9bdb877e31b444c78bdb58cbc96c3a45_1599996711", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/9bdb877e31b444c78bdb58cbc96c3a45_1599996711~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/9bdb877e31b444c78bdb58cbc96c3a45_1599996711~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/9bdb877e31b444c78bdb58cbc96c3a45_1599996711~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600072448, "group_id": "6870335999172564235", "hot_value": 7401707, "label": 3, "position": 4, "related_words": null, "sentence_id": "123734", "video_count": 1, "word": "孙弈秋成为八卦核心", "word_cover": { "uri": "tos-cn-p-0015/8b047893604f48ac8c8bf78ff8374908_1599968744", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-p-0015/8b047893604f48ac8c8bf78ff8374908_1599968744~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/8b047893604f48ac8c8bf78ff8374908_1599968744~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/8b047893604f48ac8c8bf78ff8374908_1599968744~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600059643, "group_id": "6870707109018391821", "hot_value": 7296853, "label": 0, "position": 5, "related_words": null, "sentence_id": "123397", "video_count": 4, "word": "李汶翰多位后任发文", "word_cover": { "uri": "tos-cn-p-0015/7f61e9689d684674bee88e48adcef7d5", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/7f61e9689d684674bee88e48adcef7d5~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/7f61e9689d684674bee88e48adcef7d5~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/7f61e9689d684674bee88e48adcef7d5~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599966564, "group_id": "6870331092336235788", "hot_value": 7056523, "label": 3, "position": 6, "related_words": null, "sentence_id": "122868", "video_count": 5, "word": "baby版画画的baby", "word_cover": { "uri": "tos-cn-p-0015/76753804057944a98f062c31057f2e1c", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/76753804057944a98f062c31057f2e1c~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/76753804057944a98f062c31057f2e1c~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/76753804057944a98f062c31057f2e1c~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600072613, "group_id": "6870924357356918030", "hot_value": 6839907, "label": 3, "position": 7, "related_words": null, "sentence_id": "123740", "video_count": 5, "word": "易烊千玺 上线吧华彩少年", "word_cover": { "uri": "tos-cn-p-0015/2248cad113624bc282f3ca7a219e6b0d", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/2248cad113624bc282f3ca7a219e6b0d~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/2248cad113624bc282f3ca7a219e6b0d~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/2248cad113624bc282f3ca7a219e6b0d~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599974176, "group_id": "6870331056583742731", "hot_value": 6814765, "label": 3, "position": 8, "related_words": null, "sentence_id": "122969", "video_count": 1, "word": "清华大学新生高考分数大揭秘", "word_cover": { "uri": "tos-cn-p-0015/370a784972e942ea8cc90467bd374f37_1599909904", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/370a784972e942ea8cc90467bd374f37_1599909904~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/370a784972e942ea8cc90467bd374f37_1599909904~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/370a784972e942ea8cc90467bd374f37_1599909904~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599971320, "group_id": "6870476162008519943", "hot_value": 6726356, "label": 3, "position": 9, "related_words": null, "sentence_id": "122958", "video_count": 1, "word": "焉栩嘉 不要老是给我适度修图", "word_cover": { "uri": "tos-cn-p-0015/e34b2f2f19c24d59bff9301400666291", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/e34b2f2f19c24d59bff9301400666291~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/e34b2f2f19c24d59bff9301400666291~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/e34b2f2f19c24d59bff9301400666291~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1599966613, "group_id": "6870442454777910535", "hot_value": 6573571, "label": 3, "position": 10, "related_words": null, "sentence_id": "122869", "video_count": 2, "word": "沈梦辰回应耍大牌", "word_cover": { "uri": "tos-cn-p-0015/30d048da398348abbf0ac681de64f083_1599968701", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/30d048da398348abbf0ac681de64f083_1599968701~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/30d048da398348abbf0ac681de64f083_1599968701~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/30d048da398348abbf0ac681de64f083_1599968701~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599965906, "group_id": "6870336347548734733", "hot_value": 6543468, "label": 3, "position": 11, "related_words": null, "sentence_id": "122851", "video_count": 2, "word": "王源用糖画写本人名字", "word_cover": { "uri": "tos-cn-p-0015/ea0118927bff4a7ba12a7a534f91a34e_1599907291", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ea0118927bff4a7ba12a7a534f91a34e_1599907291~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ea0118927bff4a7ba12a7a534f91a34e_1599907291~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ea0118927bff4a7ba12a7a534f91a34e_1599907291~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599979626, "group_id": "6659696456422659331", "hot_value": 6347707, "label": 3, "position": 12, "related_words": null, "sentence_id": "123041", "video_count": 1, "word": "药水哥复活", "word_cover": { "uri": "tos-cn-p-0015/42b8f2397aee405a9b328c30e70149c9", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/42b8f2397aee405a9b328c30e70149c9~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/42b8f2397aee405a9b328c30e70149c9~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/42b8f2397aee405a9b328c30e70149c9~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600073934, "group_id": "6870328194958365960", "hot_value": 6288708, "label": 0, "position": 13, "related_words": null, "sentence_id": "123802", "video_count": 1, "word": "angelababy豌豆公主封面", "word_cover": { "uri": "tos-cn-p-0015/b3e26a8eb00a41af85345c4e7272eccc", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/b3e26a8eb00a41af85345c4e7272eccc~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/b3e26a8eb00a41af85345c4e7272eccc~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/b3e26a8eb00a41af85345c4e7272eccc~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599982818, "group_id": "6870500058912593166", "hot_value": 6205586, "label": 3, "position": 14, "related_words": null, "sentence_id": "123087", "video_count": 4, "word": "灰尘男友戳穿渣男套路", "word_cover": { "uri": "tos-cn-p-0015/837b61054bc04c6681dcf4f84e7c46a0", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/837b61054bc04c6681dcf4f84e7c46a0~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/837b61054bc04c6681dcf4f84e7c46a0~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/837b61054bc04c6681dcf4f84e7c46a0~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600074246, "group_id": "6870619476136662286", "hot_value": 6134166, "label": 0, "position": 15, "related_words": null, "sentence_id": "123824", "video_count": 1, "word": "吴亦凡问郑爽为什么来潮流节目", "word_cover": { "uri": "tos-cn-p-0015/720796fff13b46938b4a0eaf8809a202", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/720796fff13b46938b4a0eaf8809a202~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/720796fff13b46938b4a0eaf8809a202~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/720796fff13b46938b4a0eaf8809a202~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": false, "challenge_id": "", "event_time": 1599966679, "group_id": "6860889202301605133", "hot_value": 6126526, "label": 0, "position": 16, "related_words": null, "sentence_id": "122872", "video_count": 4, "word": "花木兰票房破亿", "word_cover": { "uri": "tos-cn-p-0015/d1f51e9391c24242aa8a0a55e73b5c43", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d1f51e9391c24242aa8a0a55e73b5c43~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d1f51e9391c24242aa8a0a55e73b5c43~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/d1f51e9391c24242aa8a0a55e73b5c43~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599965927, "group_id": "6609600988099695875", "hot_value": 5983398, "label": 0, "position": 17, "related_words": null, "sentence_id": "122852", "video_count": 2, "word": "汪苏泷 岁月神偷", "word_cover": { "uri": "tos-cn-p-0015/36b08a5cbda3482a8f9425b5508ae2c9_1599915555", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/36b08a5cbda3482a8f9425b5508ae2c9_1599915555~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/36b08a5cbda3482a8f9425b5508ae2c9_1599915555~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/36b08a5cbda3482a8f9425b5508ae2c9_1599915555~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599983883, "group_id": "6858427128623404299", "hot_value": 5976594, "label": 0, "position": 18, "related_words": null, "sentence_id": "123123", "video_count": 5, "word": "成毅泡澡花絮", "word_cover": { "uri": "tos-cn-p-0015/27896bc102384484b2e5eeac4f90a119_1599980810", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/27896bc102384484b2e5eeac4f90a119_1599980810~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/27896bc102384484b2e5eeac4f90a119_1599980810~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/27896bc102384484b2e5eeac4f90a119_1599980810~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600070245, "group_id": "6870886729080100104", "hot_value": 5962279, "label": 0, "position": 19, "related_words": null, "sentence_id": "123672", "video_count": 12, "word": "爱的变装秀", "word_cover": { "uri": "tos-cn-p-0015/790310c0f8224eb4a01f0da5ad1d3206", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/790310c0f8224eb4a01f0da5ad1d3206~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/790310c0f8224eb4a01f0da5ad1d3206~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/790310c0f8224eb4a01f0da5ad1d3206~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600056018, "group_id": "6841788195126908167", "hot_value": 5843330, "label": 0, "position": 20, "related_words": null, "sentence_id": "123387", "video_count": 119, "word": "爱的恰恰舞挑战赛", "word_cover": { "uri": "tos-cn-p-0015/d0f3dc2180cf44c291e9bf31490b3aec_1599820890", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/d0f3dc2180cf44c291e9bf31490b3aec_1599820890~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d0f3dc2180cf44c291e9bf31490b3aec_1599820890~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d0f3dc2180cf44c291e9bf31490b3aec_1599820890~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600054593, "group_id": "6652444292411299076", "hot_value": 5669350, "label": 0, "position": 21, "related_words": null, "sentence_id": "123372", "video_count": 3, "word": "易烊千玺狗啃刘海", "word_cover": { "uri": "tos-cn-p-0015/df94a8ff3be642248f83491dc6642fac_1599999787", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/df94a8ff3be642248f83491dc6642fac_1599999787~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/df94a8ff3be642248f83491dc6642fac_1599999787~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/df94a8ff3be642248f83491dc6642fac_1599999787~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600053563, "group_id": "6574875508830377220", "hot_value": 5623356, "label": 0, "position": 22, "related_words": null, "sentence_id": "123345", "video_count": 1, "word": "李现腹肌", "word_cover": { "uri": "tos-cn-p-0015/6bb725902b06478580fe6947f2548cf8_1600013737", "url_list": [ "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/6bb725902b06478580fe6947f2548cf8_1600013737~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/6bb725902b06478580fe6947f2548cf8_1600013737~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/6bb725902b06478580fe6947f2548cf8_1600013737~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599963782, "group_id": "6870336295757337864", "hot_value": 5577403, "label": 0, "position": 23, "related_words": null, "sentence_id": "122789", "video_count": 4, "word": "王源彩色印花西装", "word_cover": { "uri": "tos-cn-p-0015/54b4f6e2d0194921a9b609710038e5c7", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/54b4f6e2d0194921a9b609710038e5c7~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/54b4f6e2d0194921a9b609710038e5c7~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/54b4f6e2d0194921a9b609710038e5c7~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600072970, "group_id": "6870331250763339011", "hot_value": 5566264, "label": 0, "position": 24, "related_words": null, "sentence_id": "123753", "video_count": 1, "word": "女子持刀追砍第三者", "word_cover": { "uri": "tos-cn-p-0015/621b187ec8f14be999812c4696d401e2", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/621b187ec8f14be999812c4696d401e2~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/621b187ec8f14be999812c4696d401e2~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/621b187ec8f14be999812c4696d401e2~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600051372, "group_id": "6870827714577241351", "hot_value": 5553958, "label": 0, "position": 25, "related_words": null, "sentence_id": "123293", "video_count": 2, "word": "内马尔控告对手种族歧视", "word_cover": { "uri": "tos-cn-p-0015/ce44110ea6cb49c39e43af12f029e9a8_1600050167", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ce44110ea6cb49c39e43af12f029e9a8_1600050167~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ce44110ea6cb49c39e43af12f029e9a8_1600050167~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/ce44110ea6cb49c39e43af12f029e9a8_1600050167~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": false, "challenge_id": "", "event_time": 1599963079, "group_id": "6870336445996619015", "hot_value": 5464887, "label": 0, "position": 26, "related_words": null, "sentence_id": "122774", "video_count": 2, "word": "王一博被苏恋雅吓到", "word_cover": { "uri": "tos-cn-p-0015/a4b34ce273fd40f4a0e9d04322fc78ec", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/a4b34ce273fd40f4a0e9d04322fc78ec~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/a4b34ce273fd40f4a0e9d04322fc78ec~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/a4b34ce273fd40f4a0e9d04322fc78ec~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600058775, "group_id": "6870333235470341380", "hot_value": 5226055, "label": 0, "position": 27, "related_words": null, "sentence_id": "123396", "video_count": 10, "word": "重启第二季听雷小队", "word_cover": { "uri": "tos-cn-p-0015/e23c141d08f84568abe5c3eeb62b07c2_1600006421", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/e23c141d08f84568abe5c3eeb62b07c2_1600006421~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/e23c141d08f84568abe5c3eeb62b07c2_1600006421~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/e23c141d08f84568abe5c3eeb62b07c2_1600006421~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600053440, "group_id": "6870809749081822472", "hot_value": 5179834, "label": 0, "position": 28, "related_words": null, "sentence_id": "123343", "video_count": 1, "word": "虞书欣翻不过来跟头", "word_cover": { "uri": "tos-cn-p-0015/76db0fbdb51a4efe9656ca0d1a422359", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/76db0fbdb51a4efe9656ca0d1a422359~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/76db0fbdb51a4efe9656ca0d1a422359~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/76db0fbdb51a4efe9656ca0d1a422359~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1599966193, "group_id": "6870334153968473358", "hot_value": 5032159, "label": 0, "position": 29, "related_words": null, "sentence_id": "122858", "video_count": 2, "word": "朴树 当前不会再当老师了", "word_cover": { "uri": "tos-cn-p-0015/31393cc4f33846afae6c4fed9054ecfa", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/31393cc4f33846afae6c4fed9054ecfa~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/31393cc4f33846afae6c4fed9054ecfa~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/31393cc4f33846afae6c4fed9054ecfa~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600071593, "group_id": "6867533249142248716", "hot_value": 5024375, "label": 0, "position": 30, "related_words": null, "sentence_id": "123704", "video_count": 1, "word": "药水哥放弃复活", "word_cover": { "uri": "tos-cn-p-0015/65f883d60a9744d4a3e94b65e6dbcc98_1599987799", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/65f883d60a9744d4a3e94b65e6dbcc98_1599987799~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/65f883d60a9744d4a3e94b65e6dbcc98_1599987799~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/65f883d60a9744d4a3e94b65e6dbcc98_1599987799~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600052903, "group_id": "6870733658765677837", "hot_value": 5018390, "label": 0, "position": 31, "related_words": null, "sentence_id": "123317", "video_count": 1, "word": "雷佳音贾乃亮唱迪丽热巴", "word_cover": { "uri": "tos-cn-p-0015/70f96bb807e84cf58991ddbaab6282b0", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/70f96bb807e84cf58991ddbaab6282b0~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/70f96bb807e84cf58991ddbaab6282b0~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/70f96bb807e84cf58991ddbaab6282b0~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600069302, "group_id": "6783609234119464199", "hot_value": 4847371, "label": 0, "position": 32, "related_words": null, "sentence_id": "123644", "video_count": 5, "word": "李现出演夺冠", "word_cover": { "uri": "tos-cn-p-0015/d24485e5b1e04589a6abe44f90120c87_1600063590", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d24485e5b1e04589a6abe44f90120c87_1600063590~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/d24485e5b1e04589a6abe44f90120c87_1600063590~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/d24485e5b1e04589a6abe44f90120c87_1600063590~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600067149, "group_id": "6870836252841923847", "hot_value": 4833962, "label": 0, "position": 33, "related_words": null, "sentence_id": "123589", "video_count": 1, "word": "向佐回应没陪郭碧婷待产", "word_cover": { "uri": "tos-cn-p-0015/5f79be2db31f437eb3afd6b427c2f477", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5f79be2db31f437eb3afd6b427c2f477~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5f79be2db31f437eb3afd6b427c2f477~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5f79be2db31f437eb3afd6b427c2f477~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": false, "challenge_id": "", "event_time": 1600063930, "group_id": "6870322401289704716", "hot_value": 4832308, "label": 0, "position": 34, "related_words": null, "sentence_id": "123486", "video_count": 1, "word": "黄子韬爸爸追悼会", "word_cover": { "uri": "tos-cn-p-0015/73f135bd1ab34f3d9fb3c292b5f3c7a2", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73f135bd1ab34f3d9fb3c292b5f3c7a2~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73f135bd1ab34f3d9fb3c292b5f3c7a2~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/73f135bd1ab34f3d9fb3c292b5f3c7a2~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1599975389, "group_id": "6870332313344005390", "hot_value": 4805388, "label": 0, "position": 35, "related_words": null, "sentence_id": "122992", "video_count": 22, "word": "军训比舞大赛", "word_cover": { "uri": "tos-cn-p-0015/d4aa875f10724caf9f5d13db36a36bfe", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/d4aa875f10724caf9f5d13db36a36bfe~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d4aa875f10724caf9f5d13db36a36bfe~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/d4aa875f10724caf9f5d13db36a36bfe~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600051218, "group_id": "6712063427679884547", "hot_value": 4690803, "label": 0, "position": 36, "related_words": null, "sentence_id": "123290", "video_count": 21, "word": "掘金19分逆转", "word_cover": { "uri": "tos-cn-p-0015/5a68e409a2f94c7db4dfb12bd6c5eb13", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5a68e409a2f94c7db4dfb12bd6c5eb13~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5a68e409a2f94c7db4dfb12bd6c5eb13~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5a68e409a2f94c7db4dfb12bd6c5eb13~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": false, "challenge_id": "", "event_time": 1599964420, "group_id": "6870404418421576968", "hot_value": 4530540, "label": 0, "position": 37, "related_words": null, "sentence_id": "122806", "video_count": 3, "word": "告白失败大喊王俊凯来了", "word_cover": { "uri": "tos-cn-p-0015/a2cd04057d1c470d9ba9d5a60993fdec", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/a2cd04057d1c470d9ba9d5a60993fdec~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/a2cd04057d1c470d9ba9d5a60993fdec~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/a2cd04057d1c470d9ba9d5a60993fdec~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600066948, "group_id": "6870833998140314893", "hot_value": 3913637, "label": 0, "position": 38, "related_words": null, "sentence_id": "123574", "video_count": 1, "word": "夫妻捡来聋哑流浪汉关照26年", "word_cover": { "uri": "tos-cn-p-0015/426027a06b5e4e9788902cc4ece6c39e_1600054111", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/426027a06b5e4e9788902cc4ece6c39e_1600054111~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/426027a06b5e4e9788902cc4ece6c39e_1600054111~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/426027a06b5e4e9788902cc4ece6c39e_1600054111~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600075288, "group_id": "6870335475686118667", "hot_value": 3863977, "label": 0, "position": 39, "related_words": null, "sentence_id": "123843", "video_count": 1, "word": "孙兴慜寄语武磊", "word_cover": { "uri": "tos-cn-p-0015/ba1d00fbfe304da1893e495c57fe08cf", "url_list": [ "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ba1d00fbfe304da1893e495c57fe08cf~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/ba1d00fbfe304da1893e495c57fe08cf~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/ba1d00fbfe304da1893e495c57fe08cf~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600067089, "group_id": "6870335781849847044", "hot_value": 3804432, "label": 0, "position": 40, "related_words": null, "sentence_id": "123584", "video_count": 1, "word": "老人吃50个饺子老板分文未收", "word_cover": { "uri": "tos-cn-p-0015/75af1cb60e6440bc94a27179e10aba53", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/75af1cb60e6440bc94a27179e10aba53~noop.jpeg?from=3218412987", "https://p9-dy.byteimg.com/img/tos-cn-p-0015/75af1cb60e6440bc94a27179e10aba53~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/75af1cb60e6440bc94a27179e10aba53~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1599969867, "group_id": "6858016893794522375", "hot_value": 3803367, "label": 0, "position": 41, "related_words": null, "sentence_id": "122922", "video_count": 24, "word": "重启第二季开播", "word_cover": { "uri": "tos-cn-p-0015/dbb567abd0b9475a9094221a398b4125", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/dbb567abd0b9475a9094221a398b4125~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/dbb567abd0b9475a9094221a398b4125~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/dbb567abd0b9475a9094221a398b4125~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600073260, "group_id": "6870939234296894728", "hot_value": 3748050, "label": 0, "position": 42, "related_words": null, "sentence_id": "123761", "video_count": 1, "word": "郑爽说本人是新人", "word_cover": { "uri": "tos-cn-p-0015/148828fd578b474cba7dc16e973299a3", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/148828fd578b474cba7dc16e973299a3~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/148828fd578b474cba7dc16e973299a3~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/148828fd578b474cba7dc16e973299a3~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600072657, "group_id": "6870867818461336840", "hot_value": 3714452, "label": 0, "position": 43, "related_words": null, "sentence_id": "123741", "video_count": 3, "word": "吴亦凡雕金玉面口罩", "word_cover": { "uri": "tos-cn-p-0015/baad04124d794cfb9a850f462b75bddd", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0015/baad04124d794cfb9a850f462b75bddd~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/baad04124d794cfb9a850f462b75bddd~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/baad04124d794cfb9a850f462b75bddd~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600051039, "group_id": "6870329912952706316", "hot_value": 3656293, "label": 0, "position": 44, "related_words": null, "sentence_id": "123287", "video_count": 2, "word": "西班牙人3-0阿尔瓦塞特", "word_cover": { "uri": "tos-cn-p-0000/88a28bae20c246578d321778fc569885", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0000/88a28bae20c246578d321778fc569885~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0000/88a28bae20c246578d321778fc569885~noop.jpeg?from=3218412987", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-p-0000/88a28bae20c246578d321778fc569885~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600010998, "group_id": "6870759860377212174", "hot_value": 3604162, "label": 5, "position": 45, "related_words": null, "room_count": 0, "sentence_id": "123267", "video_count": 5, "word": "村支书雇凶杀人受害者儿子发声", "word_cover": { "uri": "tos-cn-p-0015/7c36637b9109463086ce9dfd440ea0db", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/7c36637b9109463086ce9dfd440ea0db~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/7c36637b9109463086ce9dfd440ea0db~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/7c36637b9109463086ce9dfd440ea0db~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600068809, "group_id": "6870891347928536334", "hot_value": 3575625, "label": 0, "position": 46, "related_words": null, "sentence_id": "123635", "video_count": 1, "word": "交警你好 我能够超速一下吗", "word_cover": { "uri": "tos-cn-p-0015/5092da09a116491b9e9673a339dddd97_1599991310", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/5092da09a116491b9e9673a339dddd97_1599991310~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/5092da09a116491b9e9673a339dddd97_1599991310~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/5092da09a116491b9e9673a339dddd97_1599991310~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600064522, "group_id": "6870867789567366414", "hot_value": 3558183, "label": 1, "position": 47, "related_words": null, "sentence_id": "123496", "video_count": 18, "word": "我与冲浪只差个自拍杆", "word_cover": { "uri": "tos-cn-p-0015/73d42be9b0cd4cd5b3952d8d03e9f9f4", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/73d42be9b0cd4cd5b3952d8d03e9f9f4~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73d42be9b0cd4cd5b3952d8d03e9f9f4~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73d42be9b0cd4cd5b3952d8d03e9f9f4~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600073772, "group_id": "6870556008473957640", "hot_value": 3459750, "label": 0, "position": 48, "related_words": null, "sentence_id": "123788", "video_count": 1, "word": "拼多多勾销iPhone12预约页面", "word_cover": { "uri": "tos-cn-p-0015/73c690076f0042e2abc1c8520fdc2673_1600067811", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/73c690076f0042e2abc1c8520fdc2673_1600067811~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73c690076f0042e2abc1c8520fdc2673_1600067811~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/73c690076f0042e2abc1c8520fdc2673_1600067811~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "can_extend_detail": true, "challenge_id": "", "event_time": 1600070292, "group_id": "6870847798889174286", "hot_value": 3421434, "label": 0, "position": 49, "related_words": null, "sentence_id": "123674", "video_count": 6, "word": "成都出台房产新政15条", "word_cover": { "uri": "tos-cn-p-0015/7dc4cccb8e5c42b5997b56270237ccef_1600059706", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-p-0015/7dc4cccb8e5c42b5997b56270237ccef_1600059706~noop.jpeg?from=3218412987", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/7dc4cccb8e5c42b5997b56270237ccef_1600059706~noop.jpeg?from=3218412987", "https://p26-dy.byteimg.com/img/tos-cn-p-0015/7dc4cccb8e5c42b5997b56270237ccef_1600059706~noop.jpeg?from=3218412987" ] }, "word_type": 1 }, { "challenge_id": "", "event_time": 1600077890, "group_id": "6872193892844360971", "hot_value": 3409690, "label": 0, "position": 50, "related_words": null, "sentence_id": "123879", "video_count": 2, "word": "钟美美上GQ封面", "word_cover": { "uri": "tos-cn-p-0015/02ea9569c3894f93827aea37103adb9d", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/02ea9569c3894f93827aea37103adb9d~noop.jpeg?from=3218412987", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-p-0015/02ea9569c3894f93827aea37103adb9d~noop.jpeg?from=3218412987", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/02ea9569c3894f93827aea37103adb9d~noop.jpeg?from=3218412987" ] }, "word_type": 1 } ] }, "extra": { "fatal_item_ids": [ ], "logid": "202009142327000101980582070932F9A4", "now": 1600097220000 }, "log_pb": { "impr_id": "202009142327000101980582070932F9A4" }, "status_code": 0 }, "msg": "success"}

November 20, 2020 · 10 min · jiezi

关于大数据:抖音榜单Api明星榜

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音榜单：明星榜Api：申请Apihttp://主机地址/douyin/board/star?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code": 200, "data": { "active_time": "09月14日 23:00", "banner_url": { "uri": "209c30000d4a8cf2f9370", "url_list": [ "https://p9-dy.byteimg.com/obj/209c30000d4a8cf2f9370?from=568394430", "https://p1-dy-ipv6.byteimg.com/obj/209c30000d4a8cf2f9370?from=568394430", "https://p6-dy-ipv6.byteimg.com/obj/209c30000d4a8cf2f9370?from=568394430" ] }, "extra": { "fatal_item_ids": [ ], "logid": "202009142324410101980650392E32B7C7", "now": 1600097081000 }, "is_activity_online": false, "log_pb": { "impr_id": "202009142324410101980650392E32B7C7" }, "share_info": { "share_link_desc": "我在看抖音明星爱DOU榜，发现最火的明星，赶快来看！戳这里>>", "share_title": "我在看抖音明星爱DOU榜，发现最火的明星，赶快来看！", "share_url": "https://www.iesdouyin.com/share/billboard/star/" }, "status_code": 0, "user_list": [ { "factor_hot_value": 28884, "factor_interact_value": 2153663, "honor_tags": [ 2 ], "hot_value": 2182550, "hot_value_bar": 95, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2ddc5000133f9b3c2d273", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2ddc5000133f9b3c2d273.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2ddc5000133f9b3c2d273.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/2ddc5000133f9b3c2d273.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2ddc5000133f9b3c2d273", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2ddc5000133f9b3c2d273.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2ddc5000133f9b3c2d273.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2ddc5000133f9b3c2d273.jpeg?from=4010531038" ] }, "nickname": "张庭", "sec_uid": "MS4wLjABAAAAmvx03_4dmvU4IouLcpVqVvabF3rgKym0WjOjLoVqPos", "signature": "????9月27日晚直播\n\n工作分割：\n1469651851@qq.com", "status": 1, "uid": "98282802298", "user_rate": 1 } }, { "factor_hot_value": 46774, "factor_interact_value": 1586191, "honor_tags": [ ], "hot_value": 1632968, "hot_value_bar": 82, "is_new": false, "rank_diff": 1, "room_id": "6872235297951648523", "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/tos-cn-i-0813/6d7175426753489f8534ea982113753b", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_1080x1080.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/tos-cn-i-0813/6d7175426753489f8534ea982113753b", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/6d7175426753489f8534ea982113753b~c5_100x100.jpeg?from=4010531038" ] }, "nickname": "曹颖（明天温碧泉宠粉专场）", "sec_uid": "MS4wLjABAAAANZpTtHlyLvIrc0oT352ZD7az33fhZbStjpQicA0X-EU", "signature": "周四娱乐直播，周日带货直播\n平时随缘直播\n商务V：请加 simon160606 （北福优品）\n直播售后，请猛戳惟一小助手抖音号：82336087\n私加你的都是骗子，请进步防欺骗意识啊", "status": 1, "uid": "102385302082", "user_rate": 1 } }, { "factor_hot_value": 3388, "factor_interact_value": 1551739, "honor_tags": [ ], "hot_value": 1555130, "hot_value_bar": 80, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2d319000348f2935b97cf", "url_list": [ "https://p29-dy.byteimg.com/aweme/1080x1080/2d319000348f2935b97cf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2d319000348f2935b97cf.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2d319000348f2935b97cf.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2d319000348f2935b97cf", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/2d319000348f2935b97cf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2d319000348f2935b97cf.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2d319000348f2935b97cf.jpeg?from=4010531038" ] }, "nickname": "李小璐Super璐", "sec_uid": "MS4wLjABAAAAMpKkN60Qjn0DDrJfJFk5VDFak61mzKVElnjN_IAEsPw", "signature": "小????：李小璐lulu", "status": 1, "uid": "104682176689", "user_rate": 1 } }, { "factor_hot_value": 42, "factor_interact_value": 947194, "honor_tags": [ ], "hot_value": 947239, "hot_value_bar": 66, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2e3ad0006f1ce98140e93", "url_list": [ "https://p26-dy.byteimg.com/aweme/1080x1080/2e3ad0006f1ce98140e93.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2e3ad0006f1ce98140e93.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/2e3ad0006f1ce98140e93.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2e3ad0006f1ce98140e93", "url_list": [ "https://p26-dy.byteimg.com/aweme/100x100/2e3ad0006f1ce98140e93.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e3ad0006f1ce98140e93.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/2e3ad0006f1ce98140e93.jpeg?from=4010531038" ] }, "nickname": "涂磊", "sec_uid": "MS4wLjABAAAAyj9GWtEMNtvyynBb2MaVe_nWeq0fkomuURHCHelaSAA", "signature": "商务单干????wx:BY_coming", "status": 1, "uid": "58078054954", "user_rate": 1 } }, { "factor_hot_value": 88386, "factor_interact_value": 690350, "honor_tags": [ ], "hot_value": 784299, "hot_value_bar": 62, "is_new": false, "rank_diff": 1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_1080x1080.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3", "url_list": [ "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/3f628ba7ae82cc2c211baa6431b29ae3~c5_100x100.jpeg?from=4010531038" ] }, "nickname": "成毅", "sec_uid": "MS4wLjABAAAAgQTDRNG_L4N5aqJsk99MxgOZze1y71ER53Rawuzs_erKJCIgJNJBo3VisvC4PPW7", "signature": "", "status": 1, "uid": "1450944909280504", "user_rate": 1 } }, { "factor_hot_value": 61884, "factor_interact_value": 621777, "honor_tags": [ ], "hot_value": 704064, "hot_value_bar": 61, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/fa5a000368a5098c3d15", "url_list": [ "https://p9-dy.byteimg.com/aweme/1080x1080/fa5a000368a5098c3d15.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/fa5a000368a5098c3d15.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/fa5a000368a5098c3d15.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/fa5a000368a5098c3d15", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/fa5a000368a5098c3d15.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/fa5a000368a5098c3d15.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/fa5a000368a5098c3d15.jpeg?from=4010531038" ] }, "nickname": "陈赫", "sec_uid": "MS4wLjABAAAAAEtO1dCIZvj4VWbLU4Xce7DgVgsKNMNu88eNR2c2LtY", "signature": "????帅到没敌人\n????????♂️有货色直播间\n????9️0️6️????", "status": 1, "uid": "84990209480", "user_rate": 1 } }, { "factor_hot_value": 30676, "factor_interact_value": 461334, "honor_tags": [ ], "hot_value": 492013, "hot_value_bar": 56, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/3152e0002371d5b604412", "url_list": [ "https://p26-dy.byteimg.com/aweme/1080x1080/3152e0002371d5b604412.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3152e0002371d5b604412.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/3152e0002371d5b604412.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/3152e0002371d5b604412", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3152e0002371d5b604412.jpeg?from=4010531038" ] }, "nickname": "陈彦妃", "sec_uid": "MS4wLjABAAAA_3NdL-E9pUk58ZefAqX0RQVsMfQtFqLNL1KpgQh6_YSO4JhKefisXYDiZiafe6d1", "signature": "中国边疆女演员，代表作《星梦缘》《爱的创可贴》\n工作分割Coco 微信ID：cocosweety_huahua", "status": 1, "uid": "2326200557505672", "user_rate": 1 } }, { "factor_hot_value": 60, "factor_interact_value": 451495, "honor_tags": [ ], "hot_value": 451558, "hot_value_bar": 55, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/fce30006936e5962c541", "url_list": [ "https://p29-dy.byteimg.com/aweme/1080x1080/fce30006936e5962c541.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/fce30006936e5962c541.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/fce30006936e5962c541.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/fce30006936e5962c541", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/fce30006936e5962c541.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/fce30006936e5962c541.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/fce30006936e5962c541.jpeg?from=4010531038" ] }, "nickname": "毛晓彤", "sec_uid": "MS4wLjABAAAALTVw6qP34qqsNJ6xqN6jRRkJ78edpGiaIw-YeZGDvTk", "signature": "一只典型的瓶子♒️\n除本账号之外无其余任何抖音直播账号\n????maoxiaotongstudio@vip.163.com", "status": 1, "uid": "63685564960", "user_rate": 1 } }, { "factor_hot_value": 32, "factor_interact_value": 420670, "honor_tags": [ ], "hot_value": 420705, "hot_value_bar": 54, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/1e18000051060e06761b2", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/1e18000051060e06761b2.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/1e18000051060e06761b2.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/1e18000051060e06761b2.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/1e18000051060e06761b2", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/1e18000051060e06761b2.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/1e18000051060e06761b2.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/1e18000051060e06761b2.jpeg?from=4010531038" ] }, "nickname": "王祖蓝", "sec_uid": "MS4wLjABAAAAoHTl2cs7OqpyinoAiGghqplvqO2xtBNF1Q1eIuJv_Ww", "signature": "", "status": 1, "uid": "98351247903", "user_rate": 1 } }, { "factor_hot_value": 82846, "factor_interact_value": 323364, "honor_tags": [ ], "hot_value": 406213, "hot_value_bar": 54, "is_new": false, "rank_diff": 1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2e61a000946458f76db85", "url_list": [ "https://p29-dy.byteimg.com/aweme/1080x1080/2e61a000946458f76db85.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/2e61a000946458f76db85.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2e61a000946458f76db85.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2e61a000946458f76db85", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e61a000946458f76db85.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/2e61a000946458f76db85.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2e61a000946458f76db85.jpeg?from=4010531038" ] }, "nickname": "牛莉", "sec_uid": "MS4wLjABAAAARyUhhg4g_OEb17OmgvevqTeeYSE7xycPBh0yepfm8Qo", "signature": "顺其自然\n工作联系电话：\n经纪人： 孙女士18612653371\n简女士13604137002", "status": 1, "uid": "97225777319", "user_rate": 1 } }, { "factor_hot_value": 24382, "factor_interact_value": 363722, "honor_tags": [ ], "hot_value": 405507, "hot_value_bar": 54, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/5fdf00193d8e014576b8", "url_list": [ "https://p9-dy.byteimg.com/aweme/1080x1080/5fdf00193d8e014576b8.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/5fdf00193d8e014576b8.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/5fdf00193d8e014576b8.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/5fdf00193d8e014576b8", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/5fdf00193d8e014576b8.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/5fdf00193d8e014576b8.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/5fdf00193d8e014576b8.jpeg?from=4010531038" ] }, "nickname": "Angelababy", "sec_uid": "MS4wLjABAAAA9yeV8IIJxpee3_u9zb_Al3_mOA8IffgD3_ueMCQUly4", "signature": "天道酬勤", "status": 1, "uid": "80812090202", "user_rate": 1 } }, { "factor_hot_value": 13564, "factor_interact_value": 375080, "honor_tags": [ ], "hot_value": 389167, "hot_value_bar": 53, "is_new": false, "rank_diff": 6, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/mosaic-legacy/313c60007c32c184345ac", "url_list": [ "https://p9-dy.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_1080x1080.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/mosaic-legacy/313c60007c32c184345ac", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/mosaic-legacy/313c60007c32c184345ac~c5_100x100.jpeg?from=4010531038" ] }, "nickname": "杨超过", "sec_uid": "MS4wLjABAAAAEKnfa654JAJ_N5lgZDQluwsxmY0lhfmEYNQBBkwGG98", "signature": "娱乐圈小密探", "status": 1, "uid": "110403406559", "user_rate": 1 } }, { "factor_hot_value": 50514, "factor_interact_value": 329706, "honor_tags": [ ], "hot_value": 382623, "hot_value_bar": 53, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2e7c7000201126d5cf039", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2e7c7000201126d5cf039.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/2e7c7000201126d5cf039.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2e7c7000201126d5cf039.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2e7c7000201126d5cf039", "url_list": [ "https://p26-dy.byteimg.com/aweme/100x100/2e7c7000201126d5cf039.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2e7c7000201126d5cf039.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e7c7000201126d5cf039.jpeg?from=4010531038" ] }, "nickname": "张韶涵", "sec_uid": "MS4wLjABAAAARYY99-Z9WTY3-xAnyFzbXufutcX11naqatkM3BPh84w", "signature": "", "status": 1, "uid": "66610181516", "user_rate": 1 } }, { "factor_hot_value": 6740, "factor_interact_value": 359900, "honor_tags": [ ], "hot_value": 366643, "hot_value_bar": 53, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/31b5e00014b34e5163ee5", "url_list": [ "https://p26-dy.byteimg.com/aweme/1080x1080/31b5e00014b34e5163ee5.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/31b5e00014b34e5163ee5.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/31b5e00014b34e5163ee5.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/31b5e00014b34e5163ee5", "url_list": [ "https://p26-dy.byteimg.com/aweme/100x100/31b5e00014b34e5163ee5.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/31b5e00014b34e5163ee5.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/31b5e00014b34e5163ee5.jpeg?from=4010531038" ] }, "nickname": "宣璐lulu", "sec_uid": "MS4wLjABAAAAn9zPYB2c94D9djP3YiymaDmkxzT1JpqfY0IT5kQomTA", "signature": "吃货～跳舞～不定期发fong????", "status": 1, "uid": "58645554188", "user_rate": 1 } }, { "factor_hot_value": 208, "factor_interact_value": 310947, "honor_tags": [ ], "hot_value": 332158, "hot_value_bar": 52, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2e9d000028260a275e7bc", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2e9d000028260a275e7bc.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2e9d000028260a275e7bc.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2e9d000028260a275e7bc.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2e9d000028260a275e7bc", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/2e9d000028260a275e7bc.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2e9d000028260a275e7bc.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/2e9d000028260a275e7bc.jpeg?from=4010531038" ] }, "nickname": "关晓彤", "sec_uid": "MS4wLjABAAAA0iTQO-xDqMYRbtsMRUBLYTZn2TtudkG-dQysF5wF9jU", "signature": "哈哈哈哈哈哈哈哈", "status": 1, "uid": "78782477195", "user_rate": 1 } }, { "factor_hot_value": 4804, "factor_interact_value": 326979, "honor_tags": [ ], "hot_value": 331786, "hot_value_bar": 52, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/318c7000737a267c385ea", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/318c7000737a267c385ea.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/318c7000737a267c385ea.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/318c7000737a267c385ea.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/318c7000737a267c385ea", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/318c7000737a267c385ea.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/318c7000737a267c385ea.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/318c7000737a267c385ea.jpeg?from=4010531038" ] }, "nickname": "王子文Olivia", "sec_uid": "MS4wLjABAAAAXWd0YD41qwtIHdvnS_ngjEYa8HrBxmvvzNngj91I1hI", "signature": "", "status": 1, "uid": "103035627714", "user_rate": 1 } }, { "factor_hot_value": 12534, "factor_interact_value": 309970, "honor_tags": [ ], "hot_value": 323867, "hot_value_bar": 52, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "https://p3.pstatp.com/thumb/7b98001192a58ea5b76d", "url_list": [ "https://p3.pstatp.com/thumb/7b98001192a58ea5b76d" ] }, "avatar_thumb": { "uri": "https://p3.pstatp.com/thumb/7b98001192a58ea5b76d", "url_list": [ "https://p3.pstatp.com/thumb/7b98001192a58ea5b76d" ] }, "nickname": "明道", "sec_uid": "MS4wLjABAAAAP6c0d08fkjpEs4ylx397AMA3B9oR-euuUR-u_Dm8ASs", "signature": "還在學習這個軟件⋯", "status": 1, "uid": "97350455806", "user_rate": 1 } }, { "factor_hot_value": 3300, "factor_interact_value": 288897, "honor_tags": [ ], "hot_value": 292200, "hot_value_bar": 51, "is_new": false, "rank_diff": 2, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/314ed000225fde1f50b62", "url_list": [ "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/314ed000225fde1f50b62.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/314ed000225fde1f50b62.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/314ed000225fde1f50b62.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/314ed000225fde1f50b62", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/314ed000225fde1f50b62.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/314ed000225fde1f50b62.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/314ed000225fde1f50b62.jpeg?from=4010531038" ] }, "nickname": "冯巩", "sec_uid": "MS4wLjABAAAAh6tcornHHqhS6WdOvMvMJEsuMOgUjRpggx3BIBW6BFVVnSS2Gi3fahxR_Kkp1VY-", "signature": "请大家多关注我！\n单干分割：侯学生 13146277832", "status": 1, "uid": "1991933892508967", "user_rate": 1 } }, { "factor_hot_value": 346, "factor_interact_value": 16569, "honor_tags": [ ], "hot_value": 289918, "hot_value_bar": 51, "is_new": false, "rank_diff": -2, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/23fdb0006638cb0663fe6", "url_list": [ "https://p9-dy.byteimg.com/aweme/1080x1080/23fdb0006638cb0663fe6.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/23fdb0006638cb0663fe6.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/23fdb0006638cb0663fe6.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/23fdb0006638cb0663fe6", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/23fdb0006638cb0663fe6.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/23fdb0006638cb0663fe6.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/23fdb0006638cb0663fe6.jpeg?from=4010531038" ] }, "nickname": "薛之谦", "sec_uid": "MS4wLjABAAAAV9gNIy6uaO24sU0-g3Uz_kxHqIRYQrKqDXtLSBtsm5E", "signature": "我就问你有没有施展！", "status": 1, "uid": "96392803790", "user_rate": 1 } }, { "factor_hot_value": 76, "factor_interact_value": 286829, "honor_tags": [ ], "hot_value": 286908, "hot_value_bar": 51, "is_new": false, "rank_diff": 7, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/313e6000843c30e0b576b", "url_list": [ "https://p9-dy.byteimg.com/aweme/1080x1080/313e6000843c30e0b576b.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/313e6000843c30e0b576b.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/313e6000843c30e0b576b.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/313e6000843c30e0b576b", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/313e6000843c30e0b576b.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/313e6000843c30e0b576b.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/313e6000843c30e0b576b.jpeg?from=4010531038" ] }, "nickname": "整开", "sec_uid": "MS4wLjABAAAAqmKvvrdAH4WZe6MRHCzXema-Gh1H_d7GiVsRaL3jFEc", "signature": "一言难尽", "status": 1, "uid": "84494065240", "user_rate": 1 } }, { "factor_hot_value": 1104, "factor_interact_value": 278389, "honor_tags": [ ], "hot_value": 279496, "hot_value_bar": 51, "is_new": false, "rank_diff": 1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/173000002e59c194ea990", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/173000002e59c194ea990.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/173000002e59c194ea990.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/173000002e59c194ea990.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/173000002e59c194ea990", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/173000002e59c194ea990.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/173000002e59c194ea990.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/173000002e59c194ea990.jpeg?from=4010531038" ] }, "nickname": "摩登兄弟", "sec_uid": "MS4wLjABAAAAlsSt6GDLVMUG-JnioR6n5lZSuP6bUoVKXMc_52AlG8A", "signature": "用心认真唱歌.承蒙各位厚爱。围脖‘’摩登兄弟。一块玩哦", "status": 1, "uid": "56630472225", "user_rate": 1 } }, { "factor_hot_value": 133382, "factor_interact_value": 145884, "honor_tags": [ 1 ], "hot_value": 279269, "hot_value_bar": 51, "is_new": false, "rank_diff": -3, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/3150700094ce1229319b5", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3150700094ce1229319b5.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3150700094ce1229319b5.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/3150700094ce1229319b5.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/3150700094ce1229319b5", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/3150700094ce1229319b5.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3150700094ce1229319b5.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3150700094ce1229319b5.jpeg?from=4010531038" ] }, "nickname": "张靓颖", "sec_uid": "MS4wLjABAAAAhPN1fYOVotycrSwTLPVsC6KGtlKULIe5llZrIDjXEpM", "signature": "", "status": 1, "uid": "96704043670", "user_rate": 1 } }, { "factor_hot_value": 48, "factor_interact_value": 269795, "honor_tags": [ ], "hot_value": 269846, "hot_value_bar": 51, "is_new": false, "rank_diff": -2, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2f7c500036fa4f118c76a", "url_list": [ "https://p26-dy.byteimg.com/aweme/1080x1080/2f7c500036fa4f118c76a.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2f7c500036fa4f118c76a.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2f7c500036fa4f118c76a.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2f7c500036fa4f118c76a", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2f7c500036fa4f118c76a.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2f7c500036fa4f118c76a.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2f7c500036fa4f118c76a.jpeg?from=4010531038" ] }, "nickname": "冯提莫", "sec_uid": "MS4wLjABAAAAbgCnupO_NGaTAmzWnXSivCeHWrOe0wC2ZcpNvVoQfEk", "signature": "谢谢大家关注，记得给我小心心哟", "status": 1, "uid": "58958068057", "user_rate": 1 } }, { "factor_hot_value": 4964, "factor_interact_value": 245193, "honor_tags": [ ], "hot_value": 253160, "hot_value_bar": 50, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/314ef00013b78a6bbbed9", "url_list": [ "https://p29-dy.byteimg.com/aweme/1080x1080/314ef00013b78a6bbbed9.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/314ef00013b78a6bbbed9.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/314ef00013b78a6bbbed9.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/314ef00013b78a6bbbed9", "url_list": [ "https://p26-dy.byteimg.com/aweme/100x100/314ef00013b78a6bbbed9.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/314ef00013b78a6bbbed9.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/314ef00013b78a6bbbed9.jpeg?from=4010531038" ] }, "nickname": "歐陽娜娜Nana", "sec_uid": "MS4wLjABAAAAuWLelPqizjfu5w548WBDgaCJNoUCPsPgHcmoGlB9OXg", "signature": "", "status": 1, "uid": "63075266947", "user_rate": 1 } }, { "factor_hot_value": 28, "factor_interact_value": 252190, "honor_tags": [ ], "hot_value": 252221, "hot_value_bar": 50, "is_new": false, "rank_diff": -1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/2ea000005cb103814e400", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2ea000005cb103814e400.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/2ea000005cb103814e400.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2ea000005cb103814e400.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/2ea000005cb103814e400", "url_list": [ "https://p26-dy.byteimg.com/aweme/100x100/2ea000005cb103814e400.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/2ea000005cb103814e400.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/2ea000005cb103814e400.jpeg?from=4010531038" ] }, "nickname": "姜潮", "sec_uid": "MS4wLjABAAAAsC9K3vzlpgHEXJBvV9SLH1DklxJc1W2iz2kzdz7Zg5c", "signature": "????你????非主流高冷臭弟弟????", "status": 1, "uid": "110537388982", "user_rate": 1 } }, { "factor_hot_value": 5066, "factor_interact_value": 244131, "honor_tags": [ ], "hot_value": 249200, "hot_value_bar": 50, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f", "url_list": [ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/250332e89cccc740736d5420051ae24f~c5_100x100.jpeg?from=4010531038" ] }, "nickname": "孙铱", "sec_uid": "MS4wLjABAAAACrh58QBJZEooPPAUSUx5aplSGiKeltVs0cYt0johXZA", "signature": "小彩虹们的守护者????\n代表作：《以家人之名》《儿科医生》《航行少年》《虎头蛇尾》等\n商务分割：tiger36", "status": 1, "uid": "77015191244", "user_rate": 1 } }, { "factor_hot_value": 10282, "factor_interact_value": 230034, "honor_tags": [ ], "hot_value": 240319, "hot_value_bar": 50, "is_new": false, "rank_diff": 1, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "https://p3.pstatp.com/thumb/719f000d0a65fba664f7", "url_list": [ "https://p3.pstatp.com/thumb/719f000d0a65fba664f7" ] }, "avatar_thumb": { "uri": "https://p3.pstatp.com/thumb/719f000d0a65fba664f7", "url_list": [ "https://p3.pstatp.com/thumb/719f000d0a65fba664f7" ] }, "nickname": "印小天", "sec_uid": "MS4wLjABAAAAQ4k-sfGhdPYtmB-XVJ1KoESHT9xHftZgsoScrKKQDL8", "signature": "逗印 二大叔 工作分割：yxthz666@qq.com", "status": 1, "uid": "91730876660", "user_rate": 1 } }, { "factor_hot_value": 13512, "factor_interact_value": 146081, "honor_tags": [ ], "hot_value": 239996, "hot_value_bar": 50, "is_new": false, "rank_diff": -3, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7", "url_list": [ "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_1080x1080.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7", "url_list": [ "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_100x100.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/6206f9c4fd4344d3935432ea4ce83ce7~c5_100x100.jpeg?from=4010531038" ] }, "nickname": "白鹿my", "sec_uid": "MS4wLjABAAAAORCDztC7TcHbBDZ4e6JwLx6CfMzl-OIOLx6YKrcIA-U", "signature": "", "status": 1, "uid": "67262082771", "user_rate": 1 } }, { "factor_hot_value": 113818, "factor_interact_value": 121685, "honor_tags": [ ], "hot_value": 235506, "hot_value_bar": 50, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/26d9d000415a2b01fe8ac", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/26d9d000415a2b01fe8ac.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/26d9d000415a2b01fe8ac.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/26d9d000415a2b01fe8ac.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/26d9d000415a2b01fe8ac", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/26d9d000415a2b01fe8ac.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/26d9d000415a2b01fe8ac.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/26d9d000415a2b01fe8ac.jpeg?from=4010531038" ] }, "nickname": "李心艾", "sec_uid": "MS4wLjABAAAAJucHt6_uDmIcUlyCwlV-4yXRqZvB1lzNbhk0M8x4rhA", "signature": "周杰伦电影《天台》女主角\n《锦绣未央》—李长乐\n《花谢花飞花满天》—倾城公主\n《班淑传奇》、《彼岸花》\n商务分割 vx 17600031565", "status": 1, "uid": "111617580562", "user_rate": 1 } }, { "factor_hot_value": 4620, "factor_interact_value": 213789, "honor_tags": [ ], "hot_value": 218412, "hot_value_bar": 50, "is_new": false, "rank_diff": 0, "sprint": { "followers": null, "sprint": 0 }, "user_info": { "avatar_larger": { "uri": "1080x1080/add000005414f2e6a5e0", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/add000005414f2e6a5e0.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/add000005414f2e6a5e0.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/add000005414f2e6a5e0.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/add000005414f2e6a5e0", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/add000005414f2e6a5e0.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/100x100/add000005414f2e6a5e0.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/add000005414f2e6a5e0.jpeg?from=4010531038" ] }, "nickname": "张子萱", "sec_uid": "MS4wLjABAAAAHpcZPHEpljmz4p9MhxkMpMx5-idEHEi2bqYnPXtUrHc", "signature": "始终抽风 偶然失常的我", "status": 1, "uid": "87269012777", "user_rate": 1 } } ] }, "msg": "success"}

November 20, 2020 · 9 min · jiezi

关于大数据:抖音榜单Api今日最热视频榜

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音榜单：今日最热视频榜申请Apihttp://主机地址/douyin/board/videos?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "active_time":"09月14日 23:10", "aweme_list":[ { "aweme_info":{ "anchors":null, "author":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"3194c000a784b185c7dbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/3194c000a784b185c7dbf~c5_168x168.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/3194c000a784b185c7dbf~c5_168x168.webp?from=4010531038", "https://p9-dy.byteimg.com/img/3194c000a784b185c7dbf~c5_168x168.webp?from=4010531038" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"3194c000a784b185c7dbf", "url_list":[ "https://p26-dy.byteimg.com/img/3194c000a784b185c7dbf~c5_300x300.webp?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/3194c000a784b185c7dbf~c5_300x300.webp?from=4010531038", "https://p29-dy.byteimg.com/img/3194c000a784b185c7dbf~c5_300x300.webp?from=4010531038" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"3194c000a784b185c7dbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/1080x1080/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/3194c000a784b185c7dbf.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"3194c000a784b185c7dbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/3194c000a784b185c7dbf.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"3194c000a784b185c7dbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3194c000a784b185c7dbf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3194c000a784b185c7dbf.jpeg?from=4010531038" ], "width":720 }, "avatar_uri":"3194c000a784b185c7dbf", "aweme_count":0, "bind_phone":"", "birthday":"1997-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":10, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":0, "fb_expire_time":0, "follow_status":0, "follower_count":0, "follower_status":0, "followers_detail":null, "following_count":0, "gender":2, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":true, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"智哥好帅", "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAA-2ycpCvonfkwkTju9Ru3Droyc4jU6ulCKky2g1a-aQw", "secret":0, "share_info":{ "share_desc":"", "share_desc_info":"", "share_qrcode_url":{ "height":720, "uri":"38cb002c18a8e576c48c", "url_list":[ "https://p29-dy.byteimg.com/obj/38cb002c18a8e576c48c?from=2563711402", "https://p6-dy-ipv6.byteimg.com/obj/38cb002c18a8e576c48c?from=2563711402", "https://p9-dy.byteimg.com/obj/38cb002c18a8e576c48c?from=2563711402" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "share_qrcode_uri":"38cb002c18a8e576c48c", "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"78172971", "show_image_bubble":false, "signature":"当前都是咱们本人直播哦～谢谢大家的喜爱，放弃更新日常～男朋友抖音：智哥粉丝宝宝➕：ZhiGe8080单干➕：wanghan940", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":0, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"60615118989", "unique_id":"wyz258022", "unique_id_modify_time":1600097271, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":true, "with_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"", "youtube_expire_time":0 }, "author_user_id":60615118989, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6871942124015750408", "aweme_type":0, "bodydance_score":0, "cha_list":[ { "author":{ "ad_cover_url":null, "can_set_geofencing":null, "cha_list":null, "cover_url":null, "followers_detail":null, "geofencing":null, "homepage_bottom_toast":null, "item_list":null, "need_points":null, "new_story_cover":null, "platform_sync_info":null, "relative_users":null, "type_label":null, "user_tags":null, "white_cover_url":null }, "banner_list":null, "cha_attrs":null, "cha_name":"vlog日常", "cid":"1607783788304387", "collect_stat":0, "connect_music":[ ], "desc":"", "extra_attr":{ "is_live":false }, "hashtag_profile":"fcaa0001619bf869f27d", "is_challenge":0, "is_commerce":false, "is_pgcshow":false, "schema":"aweme://aweme/challenge/detail?cid=1607783788304387", "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"我在抖音加入#vlog日常 ", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"我在抖音加入#vlog日常 ", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/challenge/1607783788304387/?u_code=0", "share_weibo_desc":"我在抖音加入#vlog日常 " }, "show_items":null, "sub_type":0, "type":0, "user_count":0, "view_count":0 } ], "challenge_position":null, "city":"330100", "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "commerce_info":{ }, "cover_labels":null, "create_time":1599998710, "desc":"？？？？#vlog日常", "desc_language":"un", "distance":"", "distribute_type":1, "duration":15765, "geofencing":[ ], "geofencing_regions":null, "group_id":"6871942124015750408", "have_dashboard":false, "hot_info":{ "vb_rank":1, "vb_rank_value":45336655 }, "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_fantasy":false, "is_hash_tag":1, "is_pgcshow":false, "is_preview":0, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "item_stitch":0, "label_top_text":null, "long_video":null, "misc_info":"{"ocr_location":"{\"x_max\":0.9395277777777779,\"x_min\":0.05386111111111111,\"y_max\":0.6735156250000001,\"y_min\":0.6130625000000001}"}", "music":{ "album":"", "artists":[ ], "audition_duration":11, "author":"Aidida????", "author_deleted":false, "author_position":null, "avatar_large":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p1-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038" ], "width":720 }, "binded_challenge_id":0, "collect_stat":0, "cover_hd":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038" ], "width":720 }, "cover_large":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_1080x1080.jpeg?from=4010531038" ], "width":720 }, "cover_medium":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_720x720.jpeg?from=4010531038" ], "width":720 }, "cover_thumb":{ "height":720, "uri":"tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee", "url_list":[ "https://p1-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/0966d5b5ae19793763902b94962065ee~c5_100x100.jpeg?from=4010531038" ], "width":720 }, "dmv_auto_show":false, "duration":11, "end_time":0, "external_song_info":[ ], "extra":"{"has_edited":0,"review_unshelve_reason":0,"douyin_beats_info":{},"music_label_id":null,"reviewed":1,"beats":{"energy_trace":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1674743406216203","merged_beats":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1674743410446340","audio_effect_onset":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1674743406251012","beats_tracker":"http://p1-dy.byteimg.com/obj/ies-music/strong_beat/v3/1674743410417675"},"schedule_search_time":0,"hotsoon_review_time":-1,"aggregate_exempt_conf":[]}", "id":6859321961768585998, "id_str":"6859321961768585998", "is_audio_url_with_cookie":false, "is_commerce_music":false, "is_del_video":false, "is_matched_metadata":false, "is_original":false, "is_original_sound":true, "is_pgc":false, "is_restricted":false, "is_video_self_see":false, "lyric_short_position":null, "mid":"6859321961768585998", "music_chart_ranks":null, "mute_share":false, "offline_desc":"", "owner_handle":"652222__________", "owner_id":"4023854234615197", "owner_nickname":"Aidida????", "play_url":{ "height":720, "uri":"http://p1-dy.byteimg.com/obj/ies-music/6859321967670397704.mp3", "url_list":[ "http://p1-dy.byteimg.com/obj/ies-music/6859321967670397704.mp3", "http://p9-dy.byteimg.com/obj/ies-music/6859321967670397704.mp3" ], "width":720 }, "position":null, "prevent_download":false, "prevent_item_download_status":0, "preview_end_time":0, "preview_start_time":0, "reason_type":0, "redirect":false, "schema_url":"", "sec_uid":"MS4wLjABAAAAluTuaQn1nBi39WnSqD-6esgHmQSlGyAf6dD1lnirHnw1W5gcKS2vYHgNdKdwTxZd", "shoot_duration":11, "source_platform":23, "start_time":0, "status":1, "tag_list":null, "title":"@Aidida????创作的原声", "unshelve_countries":null, "user_count":0 }, "nickname_position":null, "origin_comment_ids":null, "poi_patch_info":{ "item_patch_poi_prompt_mark":0 }, "position":null, "prevent_download":false, "promotions":[ ], "rate":12, "region":"CN", "report_action":false, "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"#在抖音，记录美好生活#？？？？#vlog日常", "share_link_desc":"？？？？#vlog日常 %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"？？？？#vlog日常", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6871942124015750408/?region=CN&mid=6859321961768585998&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#？？？？#vlog日常" }, "share_url":"https://www.iesdouyin.com/share/video/6871942124015750408/?region=CN&mid=6859321961768585998&u_code=0&titleType=title", "sort_label":"", "statistics":{ "aweme_id":"6871942124015750408", "comment_count":78891, "digg_count":1118090, "download_count":28954, "forward_count":177, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":23790, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6871942124015750408", "dont_share_status":-1, "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "review_result":{ "review_status":0 }, "reviewed":1, "self_see":false, "video_hide_search":0, "with_fusion_goods":false, "with_goods":false }, "story_ttl":0, "text_extra":[ { "end":11, "hashtag_id":"1607783788304387", "hashtag_name":"vlog日常", "is_commerce":false, "start":4, "type":1 } ], "uniqid_position":null, "user_digged":0, "video":{ "big_thumbs":null, "bit_rate":[ { "bit_rate":1404381, "gear_name":"adapt_lowest_720", "is_bytevc1":1, "is_h265":1, "play_addr":{ "data_size":2767509, "file_cs":"c:0-26444-d877", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_bytevc1_720p_1404381", "url_list":[ "http://v6-dy-x.ixigua.com/1d86ec042a61e892a4636145819c3b4a/5f5f9a16/video/tos/cn/tos-cn-ve-15/e6e3d454648a4bb8ba0bc54f127d6687/?a=1128&br=4113&bt=1371&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=15&rc=M3JycmxpcHMzdzMzOGkzM0ApOzw5NGVoOTxpNzM0NDllM2dlYF4vX3JxaWNfLS1hLTBzc2E0Xi5jNDA2NmJjLTUvLmA6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/79e98228db7ccc404cfbebab885cac6e/5f5f9a16/video/tos/cn/tos-cn-ve-15/e6e3d454648a4bb8ba0bc54f127d6687/?a=1128&br=4113&bt=1371&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=15&rc=M3JycmxpcHMzdzMzOGkzM0ApOzw5NGVoOTxpNzM0NDllM2dlYF4vX3JxaWNfLS1hLTBzc2E0Xi5jNDA2NmJjLTUvLmA6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "play_addr_265":{ "data_size":2767509, "file_cs":"c:0-26444-d877", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_bytevc1_720p_1404381", "url_list":[ "http://v6-dy-x.ixigua.com/1d86ec042a61e892a4636145819c3b4a/5f5f9a16/video/tos/cn/tos-cn-ve-15/e6e3d454648a4bb8ba0bc54f127d6687/?a=1128&br=4113&bt=1371&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=15&rc=M3JycmxpcHMzdzMzOGkzM0ApOzw5NGVoOTxpNzM0NDllM2dlYF4vX3JxaWNfLS1hLTBzc2E0Xi5jNDA2NmJjLTUvLmA6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/79e98228db7ccc404cfbebab885cac6e/5f5f9a16/video/tos/cn/tos-cn-ve-15/e6e3d454648a4bb8ba0bc54f127d6687/?a=1128&br=4113&bt=1371&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=15&rc=M3JycmxpcHMzdzMzOGkzM0ApOzw5NGVoOTxpNzM0NDllM2dlYF4vX3JxaWNfLS1hLTBzc2E0Xi5jNDA2NmJjLTUvLmA6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "quality_type":15 }, { "bit_rate":1026167, "gear_name":"adapt_540", "is_bytevc1":1, "is_h265":1, "play_addr":{ "data_size":2022191, "file_cs":"c:0-26456-87c2", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_bytevc1_540p_1026167", "url_list":[ "http://v6-dy-x.ixigua.com/101b72e50bcb19d59b5dc19aaa4f480c/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/570dee540cc48a2fed8041a91b917556/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "play_addr_265":{ "data_size":2022191, "file_cs":"c:0-26456-87c2", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_bytevc1_540p_1026167", "url_list":[ "http://v6-dy-x.ixigua.com/101b72e50bcb19d59b5dc19aaa4f480c/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/570dee540cc48a2fed8041a91b917556/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "quality_type":28 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"tos-cn-p-0015/d02947fb614441d4aeda431de4e6b888_1599998714", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-p-0015/d02947fb614441d4aeda431de4e6b888_1599998714~noop.jpeg?from=2563711402_large", "https://p29-dy.byteimg.com/img/tos-cn-p-0015/d02947fb614441d4aeda431de4e6b888_1599998714~noop.jpeg?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-p-0015/d02947fb614441d4aeda431de4e6b888_1599998714~noop.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":5628896, "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_list":[ "http://v6-dy-x.ixigua.com/ddb44448e7a0be98a55bb77b122aff62/5f5f9a16/video/tos/cn/tos-cn-ve-15/b427299d6e4247cc9031926daa6ac8fa/?a=1128&br=7023&bt=2341&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApPDc1Nzs1NGVoNzg3Nzw1PGdlYF4vX3JxaWNfLS1hLTBzc2IwMS41LjReYTA0NDUwXl46Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/4594cb81fdd3ba80f050f9e517f9e23a/5f5f9a16/video/tos/cn/tos-cn-ve-15/b427299d6e4247cc9031926daa6ac8fa/?a=1128&br=7023&bt=2341&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApPDc1Nzs1NGVoNzg3Nzw1PGdlYF4vX3JxaWNfLS1hLTBzc2IwMS41LjReYTA0NDUwXl46Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "download_suffix_logo_addr":{ "data_size":5628896, "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_list":[ "http://v6-dy-x.ixigua.com/ddb44448e7a0be98a55bb77b122aff62/5f5f9a16/video/tos/cn/tos-cn-ve-15/b427299d6e4247cc9031926daa6ac8fa/?a=1128&br=7023&bt=2341&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApPDc1Nzs1NGVoNzg3Nzw1PGdlYF4vX3JxaWNfLS1hLTBzc2IwMS41LjReYTA0NDUwXl46Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/4594cb81fdd3ba80f050f9e517f9e23a/5f5f9a16/video/tos/cn/tos-cn-ve-15/b427299d6e4247cc9031926daa6ac8fa/?a=1128&br=7023&bt=2341&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApPDc1Nzs1NGVoNzg3Nzw1PGdlYF4vX3JxaWNfLS1hLTBzc2IwMS41LjReYTA0NDUwXl46Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "duration":15765, "dynamic_cover":{ "height":720, "uri":"tos-cn-p-0015/1e70847c26c34f13b5a7c3b2b5847a83_1599998712", "url_list":[ "https://p29-dy.byteimg.com/obj/tos-cn-p-0015/1e70847c26c34f13b5a7c3b2b5847a83_1599998712?from=2563711402_large", "https://p1-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/1e70847c26c34f13b5a7c3b2b5847a83_1599998712?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/obj/tos-cn-p-0015/1e70847c26c34f13b5a7c3b2b5847a83_1599998712?from=2563711402_large" ], "width":720 }, "has_download_suffix_logo_addr":true, "has_watermark":true, "height":1280, "is_bytevc1":0, "is_callback":true, "is_h265":0, "need_set_token":false, "origin_cover":{ "height":720, "uri":"tos-cn-p-0015/8ad38248b45d43419329ff134c22af9e_1599998712", "url_list":[ "https://p6-dy-ipv6.byteimg.com/tos-cn-p-0015/8ad38248b45d43419329ff134c22af9e_1599998712~tplv-dy-360p.jpeg?from=2563711402", "https://p3-dy-ipv6.byteimg.com/tos-cn-p-0015/8ad38248b45d43419329ff134c22af9e_1599998712~tplv-dy-360p.jpeg?from=2563711402", "https://p9-dy.byteimg.com/tos-cn-p-0015/8ad38248b45d43419329ff134c22af9e_1599998712~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":3455036, "file_cs":"c:0-26287-5d2d", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_h264_540p_1753269", "url_list":[ "http://v6-dy-x.ixigua.com/56e2ca3c52b5859e90607931ba8b0345/5f5f9a16/video/tos/cn/tos-cn-ve-15/559ba87a229b44e6a7c7e521766af123/?a=1128&br=5136&bt=1712&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApNzczaDhpNjw3Nzw0aGY7N2dlYF4vX3JxaWNfLS1hLTBzc2A2MV8wMy5eYGIwMmNhYGI6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/49625cbfd7b5b27d48369688be861c08/5f5f9a16/video/tos/cn/tos-cn-ve-15/559ba87a229b44e6a7c7e521766af123/?a=1128&br=5136&bt=1712&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApNzczaDhpNjw3Nzw0aGY7N2dlYF4vX3JxaWNfLS1hLTBzc2A2MV8wMy5eYGIwMmNhYGI6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "play_addr_265":{ "data_size":2022191, "file_cs":"c:0-26456-87c2", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_bytevc1_540p_1026167", "url_list":[ "http://v6-dy-x.ixigua.com/101b72e50bcb19d59b5dc19aaa4f480c/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/570dee540cc48a2fed8041a91b917556/5f5f9a16/video/tos/cn/tos-cn-ve-15/36723d180c4141b5bcc67a7ea2e898c0/?a=1128&br=4008&bt=1002&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=11&rc=M3JycmxpcHMzdzMzOGkzM0ApaDlmNmQ5aDs1NzQzaWQ7PGdlYF4vX3JxaWNfLS1hLTBzc15jMWAwXmBeNS5eYzQwLjY6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "play_addr_h264":{ "data_size":3455036, "file_cs":"c:0-26287-5d2d", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_h264_540p_1753269", "url_list":[ "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "play_addr_lowbr":{ "data_size":3455036, "file_cs":"c:0-26287-5d2d", "height":720, "uri":"v0300fd50000btf0lptmufbi2oaocoh0", "url_key":"v0300fd50000btf0lptmufbi2oaocoh0_h264_540p_1753269", "url_list":[ "http://v6-dy-x.ixigua.com/56e2ca3c52b5859e90607931ba8b0345/5f5f9a16/video/tos/cn/tos-cn-ve-15/559ba87a229b44e6a7c7e521766af123/?a=1128&br=5136&bt=1712&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApNzczaDhpNjw3Nzw0aGY7N2dlYF4vX3JxaWNfLS1hLTBzc2A2MV8wMy5eYGIwMmNhYGI6Yw%3D%3D&vl=&vr=", "http://v92-dy.ixigua.com/49625cbfd7b5b27d48369688be861c08/5f5f9a16/video/tos/cn/tos-cn-ve-15/559ba87a229b44e6a7c7e521766af123/?a=1128&br=5136&bt=1712&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142327500100280211971D23DD9E&lr=all&mime_type=video_mp4&qs=0&rc=M3JycmxpcHMzdzMzOGkzM0ApNzczaDhpNjw3Nzw0aGY7N2dlYF4vX3JxaWNfLS1hLTBzc2A2MV8wMy5eYGIwMmNhYGI6Yw%3D%3D&vl=&vr=", "https://aweme-hl.snssdk.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD", "https://api-hl.amemv.com/aweme/v1/play/?video_id=v0300fd50000btf0lptmufbi2oaocoh0&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_HOTSEARCH_BILLBOARD" ], "width":720 }, "ratio":"540p", "tags":null, "width":720 }, "video_control":{ "allow_download":true, "allow_duet":true, "allow_dynamic_wallpaper":true, "allow_music":true, "allow_react":true, "allow_stitch":true, "draft_progress_bar":0, "prevent_download_type":0, "share_type":1, "show_progress_bar":0, "timer_status":1 }, "video_labels":null, "video_text":[ ], "vr_type":0, "with_promotional_music":false, "without_watermark":false, "xigua_task":{ "is_xigua_task":false } }, "hot_value":45336655, "label":0 }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "banner_dark":{ "uri":"321f2000c018740c83b57", "url_list":[ "https://p9-dy.byteimg.com/obj/321f2000c018740c83b57?from=568394430", "https://p6-dy-ipv6.byteimg.com/obj/321f2000c018740c83b57?from=568394430", "https://p1-dy-ipv6.byteimg.com/obj/321f2000c018740c83b57?from=568394430" ] }, "banner_light":{ "uri":"321f00012c2a7db37c6c1", "url_list":[ "https://p6-dy-ipv6.byteimg.com/obj/321f00012c2a7db37c6c1?from=568394430", "https://p26-dy.byteimg.com/obj/321f00012c2a7db37c6c1?from=568394430", "https://p9-dy.byteimg.com/obj/321f00012c2a7db37c6c1?from=568394430" ] }, "extra":{ "fatal_item_ids":[ ], "logid":"202009142327500100280211971D23DD9E", "now":1600097271000 }, "log_pb":{ "impr_id":"202009142327500100280211971D23DD9E" }, "share_info":{ "share_link_desc":"我在看抖音热榜，发现最火的内容，赶快来看！戳这里>>", "share_title":"我在看抖音热榜，发现最火的内容，赶快来看！", "share_url":"https://www.iesdouyin.com/share/billboard/?id=1" }, "status_code":0, "status_msg":"" }, "msg":"success"}

November 20, 2020 · 4 min · jiezi

关于大数据:DataPipeline-CPO-陈雷实时数据融合之法便捷可管理

陈雷 | DataPipeline 合伙人 & CPO曾任 IBM 大中华区认知物联网实验室服务部首席数据科学家、资深参谋经理。十年治理教训，十五年数据迷信畛域与金融畛域教训。综合交通大数据利用技术国家工程实验室产业翻新部主任，西安交通大学软件学院大数据智能翻新核心主任，中国电子学会区块链专委会委员。 在确保了实时数据交融的稳定性之后，企业开始关注数据管理是否满足数字化转型和多速IT的麻利要求。实时数据交融产品的敏捷性、便捷性成为一个重点考量因素。 配置便捷传统数据处理过程的构建，往往是以月为单位交付的，例如构建一个数据仓库或一个大数据平台，咱们常常听到的倡议是建设周期不要超过半年，即便是数据仓库构建实现之后，因为须要进行大量的代码开发，新的业务剖析需要或者数据需要的交付周期也是以周为单位计算的，这很难满足业务应答市场竞争的须要，更不用说面对纷繁复杂的市场环境和竞争格局，业务状态是在一直调整变动的，这也对后端的数据撑持提出了更高的要求，数据资源作为策略资源必须在适合的工夫呈现在适合的地点，实时数据更是如此。而家喻户晓，数据处理交付周期长的根本原因是处理过程中要面对从异构语义、映射关系到运行形式、运维形式等大量问题，这就要求实时数据交融可能在提供配置式链路定义，无代码工作构建的根底上，可能将各类波及到运行稳固，运维治理的设置也配置化、自动化，从而帮忙用户将实时数据交融从原有的研发模式转变为系统配置管理模式。 部署便捷CPU、内存、存储、网络、操作系统、补丁、编译器、用户组，权限、装置、节点注册、负载再均衡，零碎部署始终以来都不是一件让人情绪愉悦的事件，这还是你做好了资源布局可能拿到系统资源的前提下，尽管近年来随着云计算技术被广泛承受，系统资源的申请、部署曾经不成问题。但当初大部分的数据处理系统的部署扩大形式都不是很敌对，兴许就像代码能力体现程序员的价值一样，命令行能力体现运维工程师的专业性，而实时数据流量的不确定性与业务部门对实时数据利用的快捷交付要求都须要可能灵便便捷的进行部署与扩大，因而就要求实时数据交融通过高效便捷的容器化部署、高度自动化的系统资源发现、注册、负载平衡机制和高度配置化的系统资源分组管理模式满足用户对部署的便捷可治理需要。 分层治理在明天的市场环境与技术倒退的独特作用下，数据管理不仅仅须要牢靠与可控性，同时为了应答挪动互联网带来的客户行为和市场需求的扭转，必须可能满足数字化转型和多速IT的麻利要求，但作为业务信息化数字化的底层根底平台，数据节点的安全性、稳定性、业务连续性是不容有失的，数据自身的一致性、准确性、完整性也是业务翻新的前提条件，更不用说对整个零碎的监控、日志、预警等根底运维工作须要遵循企业整体的信息化管理机制，因而，如何在无效地满足数据系统治理需要的前提下，晋升数据获取在各个环节的配合效率就显得至关重要。实时数据交融作为敏捷性要求最高、笼罩业务零碎数据起源最广的零碎就须要对数据节点注册、数据链路配置、数据工作构建、零碎资源分配等各个环节可能分档次、分租户、分用户进行解耦。 按需服务以后的企业环境中，再去辨别数据的所有者、使用者曾经没有意义，随着企业级的数据仓库、大数据平台、主数据管理系统、数据管控零碎的逐渐建成，获取企业级的数据曾经不是十分困难。而随着云计算的不断深入，系统资源的获取也曾经随需应变，而对于实时数据来说，因为敏捷性要求较高，流量变动频繁，就更须要可能做到按需服务，在分层治理的根底上，在保障数据资源可控的前提下，为数据利用提供更多的自主性也是体现实时数据处理便捷可治理的一个重要方面。实时数据处理该当将数据获取的范畴、数据工作的生命周期、系统资源投入的多寡等权限更多的交给理论应用数据的业务部门或利用开发人员。——无代码配置式链路定义，工作也交给上游部门本人跑了，我能够去看看我的排位了。——事物都是在倒退变动的，所以实时数据交融也须要能应答一直的进化，所以你再往下看。 在下一期的“实时数据交融之法，凋谢可扩大”中，咱们将从数据节点开放性、语义个性开放性、荡涤形式可扩大、配置性能可扩大四个方面展开讨论，请大家继续关注！

November 19, 2020 · 1 min · jiezi

关于大数据:抖音Api用户直播信息

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户直播信息Api：申请Apihttp://主机地址/douyin/user/live/info?token=xxx&uid=66598046050申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户id返回示例{ "code":200, "data":{ "data":{ "adversary_authorization_info":1, "adversary_user_status":1, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authentication_info":{ "authentication_badge":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/authentication_icon.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width":0 }, "custom_verify":"央视新闻官网账号", "enterprise_verify_reason":"央视新闻官网抖音号" }, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/30e520009a01cad2d810e", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"cctvnews", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":95769058, "following_count":26, "push_status":0 }, "follow_status":0, "gender":0, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":66598046050, "id_str":"66598046050", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600091516, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"央视新闻", "own_room":{ "room_ids":[ 6872336845759090000 ], "room_ids_str":[ "6872336845759089421" ] }, "pay_grade":{ "grade_banner":"", "grade_describe":"间隔1级还差1抖币", "grade_icon_list":[ ], "level":0, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 }, "new_live_icon":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":0, "screen_chat_type":0, "this_grade_max_diamond":1, "this_grade_min_diamond":0, "total_diamond_count":0, "upgrade_need_consume":0 }, "pay_score":0, "pay_scores":0, "poi_info":{ "is_poi_enabled":false, "poi_id":0, "poi_id_str":"", "poi_name":"" }, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "secret":0, "share_qrcode_uri":"72a4000fe1b5d865c51b", "short_id":653421556, "signature":"本宝宝临时还没想到共性签名", "special_id":"", "status":1, "telephone":"", "ticket_count":1379873, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":true, "with_fusion_shop_entry":true }, "extra":{ "now":1600091520634 }, "status_code":0 }, "msg":"success"}

November 19, 2020 · 2 min · jiezi

关于大数据:抖音Api用户信息

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户信息Api：申请Apihttp://主机地址/douyin/user/info?token=xxx&uid=66598046050申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户id返回示例{ "code": 200, "data": { "extra": { "now": 1600091272000 }, "log_pb": { "impr_id": "202009142147520101980590212E21A4C9" }, "status_code": 0, "user": { "apple_account": 0, "avatar_168x168": { "uri": "30e520009a01cad2d810e", "url_list": [ "https://p1-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p26-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p9-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038" ] }, "avatar_300x300": { "uri": "30e520009a01cad2d810e", "url_list": [ "https://p3-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p1-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p26-dy.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038" ] }, "avatar_larger": { "uri": "30e520009a01cad2d810e", "url_list": [ "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ] }, "avatar_medium": { "uri": "30e520009a01cad2d810e", "url_list": [ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "30e520009a01cad2d810e", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ] }, "aweme_count": 3467, "birthday": "", "birthday_hide_level": 0, "city": "北京", "commerce_info": { "challenge_list": [], "head_image_list": null, "offline_info_list": [], "smart_phone_list": null, "task_list": null }, "commerce_user_info": { "ad_revenue_rits": null, "has_ads_entry": false }, "commerce_user_level": 0, "country": "中国", "cover_url": [ { "uri": "c8510002be9a3a61aad2", "url_list": [ "https://p6-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=1247829622", "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=1247829622", "https://p26-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=1247829622" ] } ], "custom_verify": "央视新闻官网账号", "district": "向阳", "dongtai_count": 3474, "enterprise_user_info": "{"commerce_info":{"offline_info_list":[],"challenge_list":[],"task_list":null,"head_image_list":null,"smart_phone_list":null},"homepage_bottom_toast":[],"permissions":[{"Id":4,"Key":"LiveShop","Name":"直播电商","AppId":1128,"Status":1,"Extra":null,"Customization":null,"Parent":0},{"Id":3,"Key":"ItemShop","Name":"视频电商","AppId":1128,"Status":1,"Extra":null,"Customization":null,"Parent":0},{"Id":5,"Key":"UserShop","Name":"集体橱窗","AppId":1128,"Status":1,"Extra":null,"Customization":null,"Parent":0}]}", "enterprise_verify_reason": "央视新闻官网抖音号", "favoriting_count": 39, "follow_status": 0, "follower_count": 95769103, "follower_status": 0, "followers_detail": [ { "app_name": "aweme", "apple_id": "1142110895", "download_url": "https://d.douyin.com/JsvN/", "fans_count": 95769103, "icon": "http://p3.pstatp.com/origin/50ec00079b64de2050dc", "name": "抖音", "open_url": "snssdk1128://user/profile/66598046050?", "package_name": "com.ss.android.ugc.aweme" }, { "app_name": "news_article", "apple_id": "529092160", "download_url": "https://d.toutiao.com/YjjY/", "fans_count": 0, "icon": "http://p3.pstatp.com/origin/50ed00079a1b6b8d1fb1", "name": "头条", "open_url": "snssdk143://profile?uid=0", "package_name": "com.ss.android.article.news" }, { "app_name": "live_stream", "apple_id": "1086047750", "download_url": "http://d.huoshanzhibo.com/eFvB/", "fans_count": 0, "icon": "http://p3.pstatp.com/origin/2ea5c000abe106154adef", "name": "抖音火山版", "open_url": "snssdk1112://profile?id=0", "package_name": "com.ss.android.ugc.live" } ], "following_count": 26, "forward_count": 7, "gender": 0, "ins_id": "", "is_activity_user": false, "is_block": false, "is_blocked": false, "is_effect_artist": false, "is_gov_media_vip": true, "is_mix_user": true, "is_star": false, "iso_country_code": "", "live_commerce": true, "location": "北京", "message_chat_entry": true, "mplatform_followers_count": 95769103, "nickname": "央视新闻", "original_musician": { "digg_count": 0, "music_count": 0, "music_used_count": 0 }, "profile_story": { "ttl_story_status": 0, "unread_story_ids": null }, "profile_tab_type": 0, "province": "北京", "r_fans_group_info": {}, "recommend_reason_relation": "", "recommend_user_reason_source": 0, "room_data": "", "room_id": 6872336845759089421, "school_name": "", "sec_uid": "MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "secret": 0, "share_info": { "bool_persist": 1, "share_desc": "在抖音，记录美好生活！", "share_image_url": { "url_list": null }, "share_qrcode_url": { "uri": "72a4000fe1b5d865c51b", "url_list": [ "https://p6-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b", "https://p3-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b", "https://p9-dy.byteimg.com/obj/72a4000fe1b5d865c51b" ] }, "share_title": "快来退出抖音，让你发现最乏味的我！", "share_url": "www.iesdouyin.com/share/user/66598046050?sec_uid=MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "share_weibo_desc": "在抖音，记录美好生活！" }, "shop_micro_app": "", "short_id": "0", "show_favorite_list": true, "signature": "本宝宝临时还没想到共性签名", "signature_language": "un", "sync_to_toutiao": 0, "tab_settings": { "private_tab": { "private_tab_style": 1, "show_private_tab": false } }, "total_favorited": 3577047946, "twitter_id": "", "twitter_name": "", "uid": "66598046050", "unique_id": "cctvnews", "urge_detail": { "user_urged": 0 }, "verification_type": 1, "video_cover": {}, "video_icon": { "uri": "", "url_list": [] }, "watch_status": false, "white_cover_url": [ { "uri": "318f1000413827e122102", "url_list": [ "https://p1-dy-ipv6.byteimg.com/obj/318f1000413827e122102?from=1247829622", "https://p6-dy-ipv6.byteimg.com/obj/318f1000413827e122102?from=1247829622", "https://p29-dy.byteimg.com/obj/318f1000413827e122102?from=1247829622" ] } ], "with_commerce_enterprise_tab_entry": false, "with_commerce_entry": true, "with_fusion_shop_entry": true, "with_new_goods": false, "youtube_channel_id": "", "youtube_channel_title": "" } }, "msg": "success"}

November 19, 2020 · 2 min · jiezi

关于大数据:抖音Api用户喜欢列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户喜爱列表Api：申请Apihttp://主机地址/douyin/user/favourites?token=xxx&uid=100000004548&cursor=1577594707000申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "aweme_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "anchors":null, "author":{ "ad_cover_url":null, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p9-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p29-dy.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p26-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "custom_verify":"央视新闻官网账号", "download_setting":-1, "duet_setting":0, "enterprise_verify_reason":"央视新闻官网抖音号", "follow_status":0, "follower_status":0, "followers_detail":null, "has_unread_story":false, "hide_location":false, "is_ad_fake":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":true, "is_star":false, "is_verified":false, "language":"zh-Hans", "location":"", "nickname":"央视新闻", "prevent_download":false, "region":"CN", "relative_users":null, "room_id":6872336845759089421, "sec_uid":"MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "secret":0, "share_info":{ "share_desc":"", "share_desc_info":"", "share_qrcode_url":{ "height":720, "uri":"72a4000fe1b5d865c51b", "url_list":[ "https://p29-dy.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402", "https://p3-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "short_id":"653421556", "signature":"本宝宝临时还没想到共性签名", "stitch_setting":0, "story_count":0, "sync_to_toutiao":0, "uid":"66598046050", "unique_id":"cctvnews", "verification_type":0, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "with_commerce_entry":false }, "author_user_id":66598046050, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6710054222852787470", "aweme_type":0, "bodydance_score":0, "cha_list":null, "challenge_position":null, "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "commerce_info":{ }, "cover_labels":null, "create_time":1562307826, "desc":""嫁对了！"", "desc_language":"un", "descendants":{ "notify_msg":"头条", "platforms":[ "toutiao" ] }, "distance":"", "distribute_type":1, "duration":13816, "geofencing":[ ], "geofencing_regions":null, "group_id":"6710054222852787470", "have_dashboard":false, "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_fantasy":false, "is_hash_tag":1, "is_pgcshow":false, "is_preview":0, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "item_stitch":0, "label_top_text":null, "long_video":null, "music":{ "album":"", "artists":[ ], "audition_duration":13, "author":"央视新闻", "author_deleted":false, "author_position":null, "avatar_large":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p1-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "binded_challenge_id":0, "collect_stat":0, "cover_hd":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_large":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p1-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "dmv_auto_show":false, "duration":13, "end_time":0, "external_song_info":[ ], "extra":"{"douyin_beats_info":{},"has_edited":0,"review_unshelve_reason":0,"beats":{"energy_trace":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1640607200214023","merged_beats":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1640607208340493","audio_effect_onset":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1640607200230403","beats_tracker":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/v3/1640607208321031"},"music_label_id":null,"aggregate_exempt_conf":[],"reviewed":1,"schedule_search_time":0,"hotsoon_review_time":-1}", "id":6710028591729609485, "id_str":"6710028591729609485", "is_audio_url_with_cookie":false, "is_commerce_music":false, "is_del_video":false, "is_matched_metadata":false, "is_original":false, "is_original_sound":true, "is_pgc":false, "is_restricted":false, "is_video_self_see":false, "lyric_short_position":null, "mid":"6710028591729609485", "music_chart_ranks":null, "mute_share":false, "offline_desc":"", "owner_handle":"cctvnews", "owner_id":"66598046050", "owner_nickname":"央视新闻", "play_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/1638195637967886.mp3", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/1638195637967886.mp3", "http://p1-dy.byteimg.com/obj/ies-music/1638195637967886.mp3" ], "width":720 }, "position":null, "prevent_download":false, "prevent_item_download_status":0, "preview_end_time":0, "preview_start_time":0, "reason_type":0, "redirect":false, "schema_url":"", "sec_uid":"MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "shoot_duration":13, "source_platform":23, "start_time":0, "status":1, "strong_beat_url":{ "height":720, "uri":"http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1638206244361220", "url_list":[ "http://p9-dy.byteimg.com/obj/ies-music/strong_beat/1638206244361220", "http://p1-dy.byteimg.com/obj/ies-music/strong_beat/1638206244361220" ], "width":720 }, "tag_list":null, "title":"@央视新闻创作的原声", "unshelve_countries":null, "user_count":0 }, "nickname_position":null, "origin_comment_ids":null, "poi_patch_info":{ "item_patch_poi_prompt_mark":0 }, "position":null, "prevent_download":false, "promotions":[ ], "rate":12, "region":"CN", "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"#在抖音，记录美好生活#"嫁对了！"", "share_link_desc":""嫁对了！" %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":""嫁对了！"", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6710054222852787470/?region=CN&mid=6710028591729609485&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#"嫁对了！"" }, "share_url":"https://www.iesdouyin.com/share/video/6710054222852787470/?region=CN&mid=6710028591729609485&u_code=0&titleType=title", "sort_label":"", "statistics":{ "aweme_id":"6710054222852787470", "comment_count":101030, "digg_count":8495592, "download_count":202506, "forward_count":11957, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":172875, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6710054222852787470", "dont_share_status":-1, "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "review_result":{ "review_status":0 }, "reviewed":1, "self_see":false, "video_hide_search":0, "with_fusion_goods":false, "with_goods":false }, "text_extra":[ ], "uniqid_position":null, "user_digged":0, "video":{ "big_thumbs":null, "bit_rate":[ { "bit_rate":711138, "gear_name":"normal_540", "is_bytevc1":1, "is_h265":1, "play_addr":{ "data_size":1228137, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_key":"v0200ff70000bkfepopum7lhno8n4ecg_bytevc1_540p_711138", "url_list":[ "http://v26-dy.ixigua.com/4877482b7164f90fdbd2039e401597c8/5f5f83c2/video/m/220bb7c5dea1e4646d6aa54b258c1b3f2931162bef4b0000a9a94ee2d1be/?a=1128&br=2082&bt=694&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApaTM6ZTVkOGU8N2hlZ2Q1ZWdgMTVraWptbWNfLS1jLS9zczM2MC0yYTI2NTVgMDJiLl46Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/d896af4b8bc567c748a867b82216ca00/5f5f83c2/video/m/220bb7c5dea1e4646d6aa54b258c1b3f2931162bef4b0000a9a94ee2d1be/?a=1128&br=2082&bt=694&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApaTM6ZTVkOGU8N2hlZ2Q1ZWdgMTVraWptbWNfLS1jLS9zczM2MC0yYTI2NTVgMDJiLl46Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&source=PackSourceEnum_FAVORITE" ], "width":720 }, "quality_type":20 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"294490008a84e866905eb", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/300x400/294490008a84e866905eb.jpeg?from=2563711402_large", "https://p6-dy-ipv6.byteimg.com/aweme/300x400/294490008a84e866905eb.jpeg?from=2563711402_large", "https://p29-dy.byteimg.com/aweme/300x400/294490008a84e866905eb.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":2046621, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_list":[ "http://v26-dy.ixigua.com/6484564891a1b2cc13089f20ed88dbc6/5f5f83c2/video/m/220e74a6dcb90894adb8f7d2b07d4241abc1162c14f00000b0bdc2371eb7/?a=1128&br=3471&bt=1157&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApZzxoN2c5aTw4NzRoNjM1OGdgMTVraWptbWNfLS1jLS9zczVjNC5gYi8vXjQ2Yi00M2A6Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/f938520380f7e410d36f0add2ff442a6/5f5f83c2/video/m/220e74a6dcb90894adb8f7d2b07d4241abc1162c14f00000b0bdc2371eb7/?a=1128&br=3471&bt=1157&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApZzxoN2c5aTw4NzRoNjM1OGdgMTVraWptbWNfLS1jLS9zczVjNC5gYi8vXjQ2Yi00M2A6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme&source=PackSourceEnum_FAVORITE" ], "width":720 }, "download_suffix_logo_addr":{ "data_size":2133992, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_list":[ "http://v26-dy.ixigua.com/f3b2dcdf67ac240bf967fe5ba3a3f5da/5f5f83c2/video/m/2207e94d8efec0f480eb9f9328b8fb041131162bff170000b648881ff1aa/?a=1128&br=2940&bt=980&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApPDg5MzwzOmRnNzQ5ZDc7aGdgMTVraWptbWNfLS1jLS9zczUzYWI1NjE2XzQwYjA0MS46Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/3d00e1603d600a37598fa297c2bcda05/5f5f83c2/video/m/2207e94d8efec0f480eb9f9328b8fb041131162bff170000b648881ff1aa/?a=1128&br=2940&bt=980&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApPDg5MzwzOmRnNzQ5ZDc7aGdgMTVraWptbWNfLS1jLS9zczUzYWI1NjE2XzQwYjA0MS46Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_suffix&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_suffix&source=PackSourceEnum_FAVORITE" ], "width":720 }, "duration":13816, "dynamic_cover":{ "height":720, "uri":"299910008a0ae666fb265", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/299910008a0ae666fb265?from=2563711402_large", "https://p29-dy.byteimg.com/obj/299910008a0ae666fb265?from=2563711402_large", "https://p26-dy.byteimg.com/obj/299910008a0ae666fb265?from=2563711402_large" ], "width":720 }, "has_download_suffix_logo_addr":true, "has_watermark":true, "height":996, "is_bytevc1":0, "is_callback":true, "is_h265":0, "need_set_token":false, "origin_cover":{ "height":720, "uri":"2970e000c6aa1f1934a19", "url_list":[ "https://p9-dy.byteimg.com/2970e000c6aa1f1934a19~tplv-dy-360p.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/2970e000c6aa1f1934a19~tplv-dy-360p.jpeg?from=2563711402", "https://p26-dy.byteimg.com/2970e000c6aa1f1934a19~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":1740894, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_key":"v0200ff70000bkfepopum7lhno8n4ecg_h264_540p_1008045", "url_list":[ "http://v26-dy.ixigua.com/35e5f6874f0b419f3e4af11a500e8c55/5f5f83c2/video/m/22039fde19edba5462586b047a5faba5dc41162c783200008e9c4e4fb52b/?a=1128&br=2952&bt=984&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApNzU2O2VmZWQ1NzU7NTs2Z2dgMTVraWptbWNfLS1jLS9zc2IzYjRgNDEwMTRhYjJeNDM6Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/431350d9b916f3a1e43ce0673f07c6a6/5f5f83c2/video/m/22039fde19edba5462586b047a5faba5dc41162c783200008e9c4e4fb52b/?a=1128&br=2952&bt=984&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApNzU2O2VmZWQ1NzU7NTs2Z2dgMTVraWptbWNfLS1jLS9zc2IzYjRgNDEwMTRhYjJeNDM6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE" ], "width":720 }, "play_addr_265":{ "data_size":1228137, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_key":"v0200ff70000bkfepopum7lhno8n4ecg_bytevc1_540p_711138", "url_list":[ "http://v26-dy.ixigua.com/4877482b7164f90fdbd2039e401597c8/5f5f83c2/video/m/220bb7c5dea1e4646d6aa54b258c1b3f2931162bef4b0000a9a94ee2d1be/?a=1128&br=2082&bt=694&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApaTM6ZTVkOGU8N2hlZ2Q1ZWdgMTVraWptbWNfLS1jLS9zczM2MC0yYTI2NTVgMDJiLl46Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/d896af4b8bc567c748a867b82216ca00/5f5f83c2/video/m/220bb7c5dea1e4646d6aa54b258c1b3f2931162bef4b0000a9a94ee2d1be/?a=1128&br=2082&bt=694&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApaTM6ZTVkOGU8N2hlZ2Q1ZWdgMTVraWptbWNfLS1jLS9zczM2MC0yYTI2NTVgMDJiLl46Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&source=PackSourceEnum_FAVORITE" ], "width":720 }, "play_addr_h264":{ "data_size":1740894, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_key":"v0200ff70000bkfepopum7lhno8n4ecg_h264_540p_1008045", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE" ], "width":720 }, "play_addr_lowbr":{ "data_size":1740894, "height":720, "uri":"v0200ff70000bkfepopum7lhno8n4ecg", "url_key":"v0200ff70000bkfepopum7lhno8n4ecg_h264_540p_1008045", "url_list":[ "http://v26-dy.ixigua.com/35e5f6874f0b419f3e4af11a500e8c55/5f5f83c2/video/m/22039fde19edba5462586b047a5faba5dc41162c783200008e9c4e4fb52b/?a=1128&br=2952&bt=984&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApNzU2O2VmZWQ1NzU7NTs2Z2dgMTVraWptbWNfLS1jLS9zc2IzYjRgNDEwMTRhYjJeNDM6Yw%3D%3D&vl=&vr=", "http://v27-dy.ixigua.com/431350d9b916f3a1e43ce0673f07c6a6/5f5f83c2/video/m/22039fde19edba5462586b047a5faba5dc41162c783200008e9c4e4fb52b/?a=1128&br=2952&bt=984&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142152370101980620980B22B3EF&lr=all&mime_type=video_mp4&qs=0&rc=amhxcms6eHJobjMzOmkzM0ApNzU2O2VmZWQ1NzU7NTs2Z2dgMTVraWptbWNfLS1jLS9zc2IzYjRgNDEwMTRhYjJeNDM6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE", "https://api.amemv.com/aweme/v1/play/?video_id=v0200ff70000bkfepopum7lhno8n4ecg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_FAVORITE" ], "width":720 }, "ratio":"540p", "tags":null, "use_static_cover":true, "width":576 }, "video_control":{ "allow_download":true, "allow_duet":true, "allow_dynamic_wallpaper":true, "allow_music":true, "allow_react":true, "allow_stitch":true, "draft_progress_bar":0, "prevent_download_type":0, "share_type":1, "show_progress_bar":0, "timer_status":1 }, "video_labels":null, "video_text":[ ], "vr_type":0, "with_promotional_music":false, "without_watermark":false, "xigua_task":{ "is_xigua_task":false } } ], "extra":{ "fatal_item_ids":[ ], "logid":"202009142152370101980620980B22B3EF", "now":1600091557000 }, "has_more":1, "hotsoon_filtered_count":0, "hotsoon_has_more":0, "hotsoon_text":"", "invalid_item_count":1, "invalid_item_id_list":[ "6638583697941466382" ], "invalid_item_text":"", "is_clear_invalid_item":0, "is_hiding_invalid_item":0, "log_pb":{ "impr_id":"202009142152370101980620980B22B3EF" }, "max_cursor":1596461464000, "min_cursor":0, "status_code":0 }, "msg":"success"}

November 19, 2020 · 3 min · jiezi

关于大数据:用户行为分析埋点实时数仓实践附用户关联源码

转自：https://blog.csdn.net/appearb... 一、概述埋点采集、用户行为剖析、实时数仓、IdMapping 此文重点讲述埋点的数据模型、数据格式、数据实时采集、加工、存储及用户关联。对于用户行为剖析的概念、意义以及埋点相干的货色此文不作赘述 二、数据模型业界比拟风行的事件、用户模型；即： who: 设施ID、登录ID       * when: 事件产生工夫、上报工夫       * where: 设施环境、网络环境、业务环境等       * what: 事件标识、事件参数 咱们的数据存储也只有events和users两张表 events：不会变的日志表且数据量大；咱们用ClickHouse的分布式表存储 users：咱们只有几百万用户，且做用户关联时会频繁依据用户id查问、更新，而且做数据分析时要和事件表关联；咱们用ClickHouse的mysql Engine存储 events建表语句： 1. -- 事件local表;按日期周分区 2. CREATE TABLE analytics.events_replica ON CLUSTER ck_cluster( 3. `track_id` String COMMENT '埋点', 4. `event_id` Int64 COMMENT '事件id', 5. `distinct_id` String COMMENT '设施id/用户核心id', 6. `user_id` Int64 COMMENT '用户表id', 7. `type` String COMMENT '埋点类型', 8. `event` String COMMENT '埋点事件', 9. `date` Date COMMENT '埋点日期', 10. `time` DateTime64 ( 3, 'Asia/Shanghai' ) COMMENT '埋点上传工夫', 11. `receive_time` DateTime64 ( 3, 'Asia/Shanghai' ) COMMENT '埋点承受工夫', 12. `day` Int64 COMMENT '埋点距1970/01/01的天数', 13. `week_id` Int64 COMMENT '埋点距1970/01/01的周数', 14. `month_id` Int64 COMMENT '埋点距1970/01/01的月数' 15. 其余业务公共字段 16. 所有事件属性 18. ) ENGINE = ReplicatedMergeTree ( '/clickhouse/tables/analytics/events_replica/{shard}', '{replica}' ) 19. PARTITION BY toMonday ( date ) 20. ORDER BY 21. ( track_id ) SETTINGS index_granularity = 8192 23. -- 事件分布式表 24. CREATE TABLE analytics.events ON CLUSTER ck_cluster 25. AS analytics.events_replica ENGINE =Distributed('ck_cluster', 'analytics', 'events_replica', rand())  users建表语句： ...

November 18, 2020 · 2 min · jiezi

关于大数据:双汇大数据方案选型从棘手的InfluxDBRedis到毫秒级查询的TDengine

双汇发展多个分厂的能源管控大数据系统次要采纳两种技术栈：InfluxDB/Redis和Kafka/Redis/HBase/Flink，对于中小型研发团队来讲，无论是零碎搭建，还是施行运维都十分辣手。通过对InfluxDB/Redis和TDengine大数据平台的性能和性能比照测试，最终将TDengine作为实施方案。 我的项目背景基于双汇发展对能源管控的需要，利用云平台技术以及电气自动化解决伎俩，对双汇发展的一级、二级、三级能源仪表进行整体革新，实现仪表组网，进一步通过边缘网关进行能源在线监测数据的采集，并上报至云平台，建设对立能源管理信息化零碎，实现能源的实时监控、报表统计、能源流向剖析与预测，升高企业单位产品能源消耗，进步经济效益，最终实现企业能源精细化治理。 总体架构能源管控平台基于公有云构建，包含残缺的IaaS层、PaaS层和SaaS层，而能源采集零碎作为管控平台中最为重要的一环，采纳TDengine作为外围数据引擎，通过Restful接口进行仪表在线数据插入，并实现大规模时序数据的高效稳固存储，同时，也为能源管控应用层提供实时数据查问、历史聚合统计、流计算和订阅服务等性能，实现能源地图监控、能耗预警、能源流向预测和能源互联综合决策，具体架构如下图所示。 TDengine要害利用Connector抉择本我的项目数据采集最要害的环节，就是将订阅到的MQTT数据插入到TDengine中，于是也就波及到了TDengine连接器的抉择，咱们平时我的项目中java应用居多，而且JDBC的性能也绝对较强，实践上，应该抉择JDBC API，但最终抉择了RESTful Connector，次要思考以下几点： 1）简洁性 毫无疑问，RESTful通用性最强，TDengine间接通过HTTP POST 申请BODY中蕴含的SQL语句来操作数据库，而且TDengine自身作为时序数据库并不提供存储过程或者事务机制，基本上都是每次执行单条SQL语句，所以RESTful在应用上很简便。 2）可移植性 本我的项目的Java利用都是部署在Kubernetes中，所以向TDengine插入数据的Java利用须要容器化部署，而之前理解到，JDBC须要依赖的本地函数库libtaos.so文件，所以容器化部署可能较为麻烦，而RESTful仅需采纳OKHttp库即可实现，移植性较强。 3）数据规模 本项目数采规模不大，大概每分钟7000条数据，甚至后续数采性能扩大到其余分厂，RESTful也齐全满足性能要求。 但总体来讲，JDBC是在插入与查问性能上具备肯定劣势的，而且反对从firstEp和secondEp抉择无效节点进行连贯（相似于Nginx的keepalive高可用），目前TDengine版本公布状况上看，JDBC的保护与晋升也是重中之重，后续我的项目也可能会向JDBC迁徙。 RESTful代码实现1）ThreadPoolExecutor线程池 订阅EMQX和RESTful插入TDengine的代码写在了同一个java服务中，每接管到一条MQTT订阅音讯，便开启一个线程向TDengine插入数据，线程均来自于线程池，初始化如下： ExecutorService pool = new ThreadPoolExecutor(150, 300, 1000, TimeUnit.MILLISECONDS, new ArrayBlockingQueue<Runnable>(100), Executors.defaultThreadFactory(),new ThreadPoolExecutor.DiscardOldestPolicy());线程池采纳基于数组的先进先出队列，采纳抛弃晚期工作的回绝策略，因为本次场景中单次RESTful插入数据量大概在100~200条，执行速度快，迟迟未执行完极可能是SQL语句异样或连贯taosd服务异样等起因，应该抛弃工作。外围线程数设为150，绝对较高，次要为了保障顶峰抗压能力。 2）OKHttp线程池 在每个ThreadPoolExecutor线程中，基于OKHttp库进行RESTful插入操作，也是采纳ConnectionPool治理 HTTP 和 HTTP/2 连贯的重用，以缩小网络提早，OKHttp重点配置如下： public ConnectionPool pool() { return new ConnectionPool(20, 5, TimeUnit.MINUTES);}即最大闲暇连接数为20，每个连贯最大闲暇工夫为5分钟，每个OKHttp插入操作采纳异步调用形式，次要代码如下： public void excuteTdengineWithSqlAsync(String sql,Callback callback) { try{ okhttp3.MediaType mediaType = okhttp3.MediaType.parse("application/octet-stream"); RequestBody body = RequestBody.create(mediaType, sql); Request request = new Request.Builder() .url(tdengineHost) .post(body) .addHeader("Authorization", "Basic cm9vdDp0YW9zZGF0YQ==") .addHeader("cache-control", "no-cache") .build(); mOkHttpClient.newCall(request).enqueue(callback); } catch (Exception e) { logger.error("执行tdengine操作报错:"+ e.getMessage()); }}3）Java打包镜像 ...

November 18, 2020 · 1 min · jiezi

关于大数据:篇四ClickHouse的可视化界面与集群状态监控

介绍tabix反对通过浏览器间接连贯 ClickHouse，不须要装置其他软件，就能够拜访ClickHouse，具备以下特点： ⾼亮语法的编辑器。⾃动命令补全。查问命令执⾏的图形剖析⼯具。配⾊⽅案选项。除此之外，还能够应用DBeaver连贯ClickHouse，本文次要介绍这两种工具的应用形式。 形式1：不装置，间接应用浏览器拜访地址为：https://github.com/tabixio/tabix。在浏览器关上上面链接 http://ui.tabix.io/进入该链接后，界面如下： 在这里，应用默认的用户名:default，明码不必填写，登录的url即是要拜访的ClickHouse Server的地址，默认端口号为8123。登录之后，界面如下： 执行查问语句： 点击DRAW按钮，能够进行可视化展现： 点击右上方的Metrics&Processes能够查看查问过程与集群情况： 形式2：内嵌形式批改配置文件：/etc/clickhouse-server/config.xml: 原配置文件该段配置被正文掉了，开释掉正文即可： <!-- Default root page on http[s] server. For example load UI from https://tabix.io/ when opening http://localhost:8123 --><http_server_default_response><![CDATA[<html ng-app="SMI2"><head><base href="http://ui.tabix.io/"></head><body><div ui-view="" class="content-ui"></div><script src="http://loader.tabix.io/master.js"></script></body></html>]]></http_server_default_response> 而后重启server，浏览器拜访：http://ckserverhost:8123，地址即为ClickHouse Server的地址。 登录之后，与之前的操作相似。 对于tabix的装置，官网给出了多种形式，感兴趣的能够参见官网https://tabix.io/doc/Install/ 上面介绍一种IDE工具，连贯ClickHouse。 形式3：应用DBeaver在一统江湖的数仓开发辅助神器--DBeaver这篇文章中介绍了DBeaver的根本应用，感兴趣的能够在回过来看一下。应用DBeaver连贯ClickHouse非常简单，然而留神ClickHouse-jdbc的驱动，最好不要应用默认下载的驱动。对于驱动的下载，见上面的地址： https://jar-download.com/?search_box=clickhouse-jdbc关上DBeaver，新建连贯，抉择ClickHouse。 点击编辑驱动设置，增加驱动 测试连贯 连贯胜利之后，界面如下，能够进行查问测试 公众号『大数据技术与数仓』，回复『材料』支付大数据资料包

November 18, 2020 · 1 min · jiezi

关于大数据:抖音Api用户视频列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户视频列表Api：申请Apihttp://主机地址/douyin/user/posts?token=xxx&uid=100000004548&cursor=1577594707000申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "aweme_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "anchors":null, "author":{ "ad_cover_url":null, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p26-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p9-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038", "https://p29-dy.byteimg.com/img/30e520009a01cad2d810e~c5_168x168.webp?from=4010531038" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p29-dy.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/30e520009a01cad2d810e~c5_300x300.webp?from=4010531038" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p26-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402", "https://p6-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2563711402" ], "width":720 } ], "custom_verify":"央视新闻官网账号", "download_setting":-1, "duet_setting":0, "enterprise_verify_reason":"央视新闻官网抖音号", "follow_status":0, "follower_status":0, "followers_detail":null, "has_unread_story":false, "hide_location":false, "is_ad_fake":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":true, "is_star":false, "is_verified":false, "language":"zh-Hans", "location":"", "nickname":"央视新闻", "original_musician":{ "digg_count":0, "music_count":0, "music_used_count":0 }, "prevent_download":false, "region":"CN", "relative_users":null, "room_id":6872336845759089421, "sec_uid":"MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "secret":0, "share_info":{ "share_desc":"", "share_desc_info":"", "share_qrcode_url":{ "height":720, "uri":"72a4000fe1b5d865c51b", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402", "https://p6-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/72a4000fe1b5d865c51b?from=2563711402" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "short_id":"653421556", "signature":"本宝宝临时还没想到共性签名", "stitch_setting":0, "story_count":0, "sync_to_toutiao":0, "uid":"66598046050", "unique_id":"cctvnews", "verification_type":0, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "with_commerce_entry":false }, "author_user_id":66598046050, "aweme_control":{ "can_comment":true, "can_forward":true, "can_share":true, "can_show_comment":true }, "aweme_id":"6871068361715879175", "aweme_type":0, "bodydance_score":0, "cha_list":[ { "author":{ "ad_cover_url":null, "can_set_geofencing":null, "cha_list":null, "cover_url":null, "followers_detail":null, "geofencing":null, "homepage_bottom_toast":null, "item_list":null, "need_points":null, "new_story_cover":null, "platform_sync_info":null, "relative_users":null, "type_label":null, "user_tags":null, "white_cover_url":null }, "banner_list":null, "cha_attrs":null, "cha_name":"紫禁城600岁", "cid":"1654975003512845", "collect_stat":0, "connect_music":[ ], "desc":"", "extra_attr":{ "is_live":false }, "hashtag_profile":"tos-cn-i-0813/d5c7be47dac24a03a66a7c031410c2a9", "is_challenge":0, "is_commerce":false, "is_pgcshow":false, "schema":"aweme://aweme/challenge/detail?cid=1654975003512845", "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"我在抖音加入#紫禁城600岁 ", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"我在抖音加入#紫禁城600岁 ", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/challenge/1654975003512845/?u_code=0", "share_weibo_desc":"我在抖音加入#紫禁城600岁 " }, "show_items":null, "sub_type":0, "type":2, "user_count":0, "view_count":0 } ], "challenge_position":null, "cmt_swt":false, "collect_stat":0, "comment_list":null, "commerce_config_data":null, "commerce_info":{ }, "cover_labels":null, "create_time":1599795299, "desc":"乾隆皇帝的颐养之所有多考究？#紫禁城600岁", "desc_language":"zh", "distance":"", "distribute_type":1, "duration":52911, "geofencing":[ ], "geofencing_regions":null, "group_id":"6871068361715879175", "have_dashboard":false, "hybrid_label":null, "image_infos":null, "interaction_stickers":null, "is_fantasy":false, "is_hash_tag":1, "is_pgcshow":false, "is_preview":0, "is_relieve":false, "is_story":0, "is_top":0, "is_vr":false, "item_comment_settings":0, "item_duet":0, "item_react":0, "item_stitch":0, "label_top":{ "height":720, "uri":"729f0000ef991e85fccf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402", "https://p29-dy.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402", "https://p1-dy-ipv6.byteimg.com/obj/729f0000ef991e85fccf?from=2563711402" ], "width":720 }, "label_top_text":null, "long_video":null, "misc_info":"{"ocr_location":"{\"x_max\":0.9661111111111111,\"x_min\":0.028444444444444446,\"y_max\":0.7420352564102564,\"y_min\":0.6112820512820513}"}", "music":{ "album":"", "artists":[ ], "audition_duration":52, "author":"央视新闻", "author_deleted":false, "author_position":null, "avatar_large":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p26-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "binded_challenge_id":0, "collect_stat":0, "cover_hd":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_large":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_medium":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/720x720/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "cover_thumb":{ "height":720, "uri":"30e520009a01cad2d810e", "url_list":[ "https://p26-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30e520009a01cad2d810e.jpeg?from=4010531038" ], "width":720 }, "dmv_auto_show":false, "duration":52, "end_time":0, "external_song_info":[ ], "extra":"{"has_edited":0,"schedule_search_time":0,"hotsoon_review_time":-1,"reviewed":1,"review_unshelve_reason":0,"beats":{},"douyin_beats_info":{},"music_label_id":null,"aggregate_exempt_conf":[]}", "id":6871068511255464712, "id_str":"6871068511255464712", "is_audio_url_with_cookie":false, "is_commerce_music":false, "is_del_video":false, "is_matched_metadata":false, "is_original":false, "is_original_sound":true, "is_pgc":false, "is_restricted":false, "is_video_self_see":false, "lyric_short_position":null, "mid":"6871068511255464712", "music_chart_ranks":null, "mute_share":false, "offline_desc":"该声音不可用", "owner_handle":"cctvnews", "owner_id":"66598046050", "owner_nickname":"央视新闻", "play_url":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "position":null, "prevent_download":false, "prevent_item_download_status":0, "preview_end_time":0, "preview_start_time":0, "reason_type":2, "redirect":false, "schema_url":"", "sec_uid":"MS4wLjABAAAAgq8cb7cn9ByhZbmx-XQDdRTvFzmJeBBXOUO4QflP96M", "shoot_duration":52, "source_platform":23, "start_time":0, "status":1, "tag_list":null, "title":"@央视新闻创作的原声", "unshelve_countries":null, "user_count":0 }, "nickname_position":null, "origin_comment_ids":null, "poi_patch_info":{ "item_patch_poi_prompt_mark":0 }, "position":null, "prevent_download":false, "promotions":[ ], "rate":12, "region":"", "risk_infos":{ "content":"", "risk_sink":false, "type":0, "vote":false, "warn":false }, "share_info":{ "bool_persist":0, "share_desc":"在抖音，记录美好生活", "share_desc_info":"#在抖音，记录美好生活#乾隆皇帝的颐养之所有多考究？#紫禁城600岁", "share_link_desc":"乾隆皇帝的颐养之所有多考究？#紫禁城600岁 %s 复制此链接，关上【抖音短视频】，间接观看视频！", "share_quote":"", "share_signature_desc":"", "share_signature_url":"", "share_title":"乾隆皇帝的颐养之所有多考究？#紫禁城600岁", "share_title_myself":"", "share_title_other":"", "share_url":"https://www.iesdouyin.com/share/video/6871068361715879175/?region=CN&mid=6871068511255464712&u_code=0&titleType=title", "share_weibo_desc":"#在抖音，记录美好生活#乾隆皇帝的颐养之所有多考究？#紫禁城600岁" }, "share_url":"https://www.iesdouyin.com/share/video/6871068361715879175/?region=CN&mid=6871068511255464712&u_code=0&titleType=title", "sort_label":"", "statistics":{ "aweme_id":"6871068361715879175", "comment_count":120, "digg_count":77976, "download_count":224, "forward_count":31, "lose_comment_count":0, "lose_count":0, "play_count":0, "share_count":185, "whatsapp_share_count":0 }, "status":{ "allow_comment":true, "allow_share":true, "aweme_id":"6871068361715879175", "dont_share_status":-1, "download_status":0, "in_reviewing":false, "is_delete":false, "is_private":false, "is_prohibited":false, "private_status":0, "review_result":{ "review_status":0 }, "reviewed":1, "self_see":false, "video_hide_search":0, "with_fusion_goods":false, "with_goods":false }, "text_extra":[ { "end":22, "hashtag_id":"1654975003512845", "hashtag_name":"紫禁城600岁", "is_commerce":false, "start":14, "type":1 } ], "uniqid_position":null, "user_digged":0, "video":{ "animated_cover":{ "uri":"tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large" ] }, "big_thumbs":null, "bit_rate":[ { "bit_rate":743878, "gear_name":"adapt_lowest_720", "is_bytevc1":1, "is_h265":1, "play_addr":{ "data_size":4919917, "file_cs":"c:0-46051-59ae", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_bytevc1_720p_743878", "url_list":[ "http://v27-dy.ixigua.com/17bf583a1b41ae10412bee1121ad31d1/5f5f82f3/video/tos/cn/tos-cn-ve-15/464976ee310244348524b27093e7ddea/?a=1128&br=2178&bt=726&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=15&rc=anhrb244dmtpdzMzOWkzM0ApM2c1OzdpaTw1NzM2Mzg7aGdtaGMtby1sLWFfLS1gLTBzc2AzMV82NWBiLl4xNmIzNTE6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/6d02c25fafee3444b8eb99c6799b9d39/5f5f82f3/video/tos/cn/tos-cn-ve-15/464976ee310244348524b27093e7ddea/?a=1128&br=2178&bt=726&cr=3&cs=2&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=15&rc=anhrb244dmtpdzMzOWkzM0ApM2c1OzdpaTw1NzM2Mzg7aGdtaGMtby1sLWFfLS1gLTBzc2AzMV82NWBiLl4xNmIzNTE6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=720p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=14&source=PackSourceEnum_PUBLISH" ], "width":720 }, "quality_type":15 }, { "bit_rate":725585, "gear_name":"adapt_540", "is_bytevc1":1, "is_h265":1, "play_addr":{ "data_size":4798933, "file_cs":"c:0-46052-0ba4", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_bytevc1_540p_725585", "url_list":[ "http://v27-dy.ixigua.com/2fb9fa59edb2eaf89196f0282bdb83aa/5f5f82f3/video/tos/cn/tos-cn-ve-15/b67083c8f8dd4fdfa112c986dd878fa6/?a=1128&br=2832&bt=708&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=11&rc=anhrb244dmtpdzMzOWkzM0ApNDNoZzozODs0N2hkZTozZmdtaGMtby1sLWFfLS1gLTBzc18vLy4zXjZeLV4uMWBhLTY6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/c1daaf6668d96d1393bf438c879b1b73/5f5f82f3/video/tos/cn/tos-cn-ve-15/b67083c8f8dd4fdfa112c986dd878fa6/?a=1128&br=2832&bt=708&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=11&rc=anhrb244dmtpdzMzOWkzM0ApNDNoZzozODs0N2hkZTozZmdtaGMtby1sLWFfLS1gLTBzc18vLy4zXjZeLV4uMWBhLTY6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH" ], "width":720 }, "quality_type":28 } ], "cdn_url_expired":0, "cover":{ "height":720, "uri":"tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logoccm:300:400:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.jpeg?from=2563711402_large", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logoccm:300:400:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.jpeg?from=2563711402_large", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logoccm:300:400:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.jpeg?from=2563711402_large" ], "width":720 }, "download_addr":{ "data_size":14413252, "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_list":[ "http://v27-dy.ixigua.com/bc59dab357735c5779ad7d978e6a7241/5f5f82f3/video/tos/cn/tos-cn-ve-15/53e0b0523aca47d884ca2d47564fa9fd/?a=1128&br=6039&bt=2013&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApZ2VlMzhlZjs2NzZkOWg4aGdtaGMtby1sLWFfLS1gLTBzc2AtYzRhNi8uYGBgLmJfX2I6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/0c396a16e6493674114297d38b639c0b/5f5f82f3/video/tos/cn/tos-cn-ve-15/53e0b0523aca47d884ca2d47564fa9fd/?a=1128&br=6039&bt=2013&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApZ2VlMzhlZjs2NzZkOWg4aGdtaGMtby1sLWFfLS1gLTBzc2AtYzRhNi8uYGBgLmJfX2I6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH" ], "width":720 }, "download_suffix_logo_addr":{ "data_size":14413252, "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_list":[ "http://v27-dy.ixigua.com/bc59dab357735c5779ad7d978e6a7241/5f5f82f3/video/tos/cn/tos-cn-ve-15/53e0b0523aca47d884ca2d47564fa9fd/?a=1128&br=6039&bt=2013&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApZ2VlMzhlZjs2NzZkOWg4aGdtaGMtby1sLWFfLS1gLTBzc2AtYzRhNi8uYGBgLmJfX2I6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/0c396a16e6493674114297d38b639c0b/5f5f82f3/video/tos/cn/tos-cn-ve-15/53e0b0523aca47d884ca2d47564fa9fd/?a=1128&br=6039&bt=2013&cr=3&cs=0&cv=1&dr=0&ds=3&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApZ2VlMzhlZjs2NzZkOWg4aGdtaGMtby1sLWFfLS1gLTBzc2AtYzRhNi8uYGBgLmJfX2I6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&watermark=1&media_type=4&vr_type=0&improve_bitrate=0&logo_name=aweme_search_suffix&quality_type=11&source=PackSourceEnum_PUBLISH" ], "width":720 }, "duration":52911, "dynamic_cover":{ "height":720, "uri":"tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/63437cffa5974286b33c139ee6e45a88~tplv-dmt-logom:tos-cn-i-0813/88762c524ac142b6a4c3abd3eb5e9de5.image?from=2563711402_large" ], "width":720 }, "has_download_suffix_logo_addr":true, "has_watermark":true, "height":998, "is_bytevc1":0, "is_callback":true, "is_h265":0, "need_set_token":false, "origin_cover":{ "height":720, "uri":"tos-cn-p-0015/49e04dbba3ea42ca8d5d195294d4245b_1599795301", "url_list":[ "https://p1-dy-ipv6.byteimg.com/tos-cn-p-0015/49e04dbba3ea42ca8d5d195294d4245b_1599795301~tplv-dy-360p.jpeg?from=2563711402", "https://p29-dy.byteimg.com/tos-cn-p-0015/49e04dbba3ea42ca8d5d195294d4245b_1599795301~tplv-dy-360p.jpeg?from=2563711402", "https://p6-dy-ipv6.byteimg.com/tos-cn-p-0015/49e04dbba3ea42ca8d5d195294d4245b_1599795301~tplv-dy-360p.jpeg?from=2563711402" ], "width":720 }, "play_addr":{ "data_size":10534115, "file_cs":"c:0-45037-1b01", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_h264_540p_1592729", "url_list":[ "http://v27-dy.ixigua.com/73036b135d4655a9c9b264ffbe95eec0/5f5f82f3/video/tos/cn/tos-cn-ve-15/25a88d7727e842cc8213128f19da0ab2/?a=1128&br=4665&bt=1555&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApMzk1aTw6ZDw1NzQ3PDk3aGdtaGMtby1sLWFfLS1gLTBzczMzNF8wXl5gNWE1NC9jYGI6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/9007ed0a64395d4b9ec384baf99e7d28/5f5f82f3/video/tos/cn/tos-cn-ve-15/25a88d7727e842cc8213128f19da0ab2/?a=1128&br=4665&bt=1555&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApMzk1aTw6ZDw1NzQ3PDk3aGdtaGMtby1sLWFfLS1gLTBzczMzNF8wXl5gNWE1NC9jYGI6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH" ], "width":720 }, "play_addr_265":{ "data_size":4798933, "file_cs":"c:0-46052-0ba4", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_bytevc1_540p_725585", "url_list":[ "http://v27-dy.ixigua.com/2fb9fa59edb2eaf89196f0282bdb83aa/5f5f82f3/video/tos/cn/tos-cn-ve-15/b67083c8f8dd4fdfa112c986dd878fa6/?a=1128&br=2832&bt=708&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=11&rc=anhrb244dmtpdzMzOWkzM0ApNDNoZzozODs0N2hkZTozZmdtaGMtby1sLWFfLS1gLTBzc18vLy4zXjZeLV4uMWBhLTY6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/c1daaf6668d96d1393bf438c879b1b73/5f5f82f3/video/tos/cn/tos-cn-ve-15/b67083c8f8dd4fdfa112c986dd878fa6/?a=1128&br=2832&bt=708&cr=3&cs=2&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=11&rc=anhrb244dmtpdzMzOWkzM0ApNDNoZzozODs0N2hkZTozZmdtaGMtby1sLWFfLS1gLTBzc18vLy4zXjZeLV4uMWBhLTY6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&bytevc1=1&quality_type=11&adapt540=1&source=PackSourceEnum_PUBLISH" ], "width":720 }, "play_addr_h264":{ "data_size":10534115, "file_cs":"c:0-45037-1b01", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_h264_540p_1592729", "url_list":[ "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&quality_type=11&source=PackSourceEnum_PUBLISH" ], "width":720 }, "play_addr_lowbr":{ "data_size":10534115, "file_cs":"c:0-45037-1b01", "height":720, "uri":"v0300fc60000btdf0hos05rk0lfhkupg", "url_key":"v0300fc60000btdf0hos05rk0lfhkupg_h264_540p_1592729", "url_list":[ "http://v27-dy.ixigua.com/73036b135d4655a9c9b264ffbe95eec0/5f5f82f3/video/tos/cn/tos-cn-ve-15/25a88d7727e842cc8213128f19da0ab2/?a=1128&br=4665&bt=1555&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApMzk1aTw6ZDw1NzQ3PDk3aGdtaGMtby1sLWFfLS1gLTBzczMzNF8wXl5gNWE1NC9jYGI6Yw%3D%3D&vl=&vr=", "http://v3-dy-y.ixigua.com/9007ed0a64395d4b9ec384baf99e7d28/5f5f82f3/video/tos/cn/tos-cn-ve-15/25a88d7727e842cc8213128f19da0ab2/?a=1128&br=4665&bt=1555&cr=3&cs=0&cv=1&dr=0&ds=6&er=&l=202009142148310101980650230821C4DC&lr=all&mime_type=video_mp4&qs=0&rc=anhrb244dmtpdzMzOWkzM0ApMzk1aTw6ZDw1NzQ3PDk3aGdtaGMtby1sLWFfLS1gLTBzczMzNF8wXl5gNWE1NC9jYGI6Yw%3D%3D&vl=&vr=", "https://aweme.snssdk.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=0&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH", "https://api.amemv.com/aweme/v1/play/?video_id=v0300fc60000btdf0hos05rk0lfhkupg&line=1&ratio=540p&media_type=4&vr_type=0&improve_bitrate=0&is_play_url=1&source=PackSourceEnum_PUBLISH" ], "width":720 }, "ratio":"540p", "tags":null, "use_static_cover":true, "width":576 }, "video_control":{ "allow_download":true, "allow_duet":true, "allow_dynamic_wallpaper":true, "allow_music":true, "allow_react":true, "allow_stitch":true, "draft_progress_bar":1, "prevent_download_type":0, "share_type":1, "show_progress_bar":1, "timer_status":1 }, "video_labels":[ ], "video_text":[ ], "vr_type":0, "with_promotional_music":false, "without_watermark":false, "xigua_task":{ "is_xigua_task":false } } ], "extra":{ "fatal_item_ids":[ ], "logid":"202009142148310101980650230821C4DC", "now":1600091311000 }, "has_more":1, "log_pb":{ "impr_id":"202009142148310101980650230821C4DC" }, "max_cursor":1599792916000, "min_cursor":1600079191000, "status_code":0 }, "msg":"success"}

November 18, 2020 · 4 min · jiezi

关于大数据:抖音Api用户商品橱窗

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户商品橱窗Api：申请Apihttp://主机地址/douyin/user/promotions?token=xxx&uid=71105932077&cursor=0申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "columns":[ { "can_reverse":false, "default_sort":0, "id":0, "name":"综合排序" }, { "can_reverse":false, "default_sort":0, "id":1, "name":"销量" }, { "can_reverse":false, "default_sort":0, "id":2, "name":"上新工夫" }, { "can_reverse":true, "default_sort":1, "id":3, "name":"价格" } ], "count":352, "extra":{ "fatal_item_ids":[ ], "logid":"2020091422095701019806020639266AEC", "now":1600092597000 }, "has_more":true, "log_pb":{ "impr_id":"2020091422095701019806020639266AEC" }, "promotions":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "brand_icon":{ "uri":"db00001bcc4cfde8d96a", "url_list":[ "http://p3.pstatp.com/origin/db00001bcc4cfde8d96a" ] }, "consumer_comment":null, "cos_fee":0, "detail_url":"https://haohuo.jinritemai.com/views/product/item2?id=3420911657696812285&origin_type=3002070010&origin_id=71105932077_3420911657696812285&alkey=1128_71105932077_0_3420911657696812285_010", "elastic_images":[ { "height":720, "uri":"temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601", "url_list":[ "http://p1.pstatp.com/aweme/720x720/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601.jpeg", "http://pb3.pstatp.com/aweme/720x720/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601.jpeg", "http://pb3.pstatp.com/aweme/720x720/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601.jpeg" ], "width":720 }, { "height":720, "uri":"temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600", "url_list":[ "http://p1.pstatp.com/aweme/720x720/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600.jpeg", "http://pb3.pstatp.com/aweme/720x720/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600.jpeg", "http://pb3.pstatp.com/aweme/720x720/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600.jpeg" ], "width":720 } ], "elastic_type":1, "favorited":false, "goods_source":"来自小店", "has_gyl":false, "images":[ { "height":720, "uri":"temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601", "url_list":[ "http://p1.pstatp.com/obj/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601", "http://pb3.pstatp.com/obj/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601", "http://pb3.pstatp.com/obj/temai/FtsKTipA-dJpYHBR7HYxqJZZ4fnEwww600-601" ], "width":720 }, { "height":720, "uri":"temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600", "url_list":[ "http://p1.pstatp.com/obj/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600", "http://pb3.pstatp.com/obj/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600", "http://pb3.pstatp.com/obj/temai/FiyKM0swr7x_ls1iopxbr_FsTXgWwww600-600" ], "width":720 } ], "jump_to_url":false, "label":null, "market_price":99900, "marketing_floors":null, "medias":null, "meta_param":"%7B%22page_type%22%3A0%7D", "min_price":99900, "module_control":{ "comment":{ "visible":true }, "order_share":{ "visible":true }, "store_card":{ "visible":true }, "store_icon":{ "visible":true }, "want":{ "visible":true } }, "pic_audit_status":null, "price":99900, "price_tag":"", "product_id":"3420911657696812285", "promotion_id":"3420911657696812285", "promotion_source":6, "sales":225, "shop_icons":[ ], "status":2, "title":"I1C096676 法式方领上衣", "toutiao":{ "aggregate_page":null, "already_buy":false, "button":{ "h5_url":"https://haohuo.jinritemai.com/views/product/buynow?id=3420911657696812285&product_id=3420911657696812285&origin_type=3002070010&origin_id=71105932077_3420911657696812285&disable_activity=0&group_id=0&alkey=1128_71105932077_0_3420911657696812285_010&new_source_type=product_detail&status_bar_color=ffffff&loading_bgcolor=ffffff&hide_nav_bar=1&status_font_dark=1", "order_status":1, "sku_confirm_text":[ "确定" ], "small_app_url":"sslocal://microapp?version=v2&app_id=tt7cca0a77e3e0cd15&scene=027001&version_type=current&start_page=pages%2Fproduct-pay%2Fproduct-pay%3Falkey%3D1128_71105932077_0_3420911657696812285_010%26disable_activity%3D0%26new_source_type%3Dproduct_detail%26origin_id%3D71105932077_3420911657696812285%26origin_type%3D3002070010%26product_id%3D3420911657696812285&bdp_log=%7B%22launch_from%22%3A%22full_screen_card%22%2C%22location%22%3A%22click_product%22%7D&bdpsum=bb62544", "text":[ "立刻购买" ] }, "cart_url":"https://haohuo.jinritemai.com/views/cart/index?status_bar_color=ffffff&loading_bgcolor=ffffff&hide_nav_bar=1&status_font_dark=1", "coupon_rule":null, "delivery_delay_text":"下单后15天内发货", "detail_url":"https://haohuo.jinritemai.com/views/product/item2?id=3420911657696812285&origin_type=3002070010&origin_id=71105932077_3420911657696812285&alkey=1128_71105932077_0_3420911657696812285_010", "im_url":"https://im.jinritemai.com/douyin_mobile_customer_from_goods/?fromGoods=3420911657696812285&origin_id=71105932077_3420911657696812285&origin_type=3002070010&alkey=1128_71105932077_0_3420911657696812285_010", "max_price":99900, "min_price":99900, "need_check":true, "order_tma_url":"sslocal://microapp?version=v2&app_id=tt7cca0a77e3e0cd15&scene=027001&version_type=current&start_page=pages%2Fproduct-pay%2Fproduct-pay%3Falkey%3D1128_71105932077_0_3420911657696812285_010%26disable_activity%3D0%26new_source_type%3Dproduct_detail%26origin_id%3D71105932077_3420911657696812285%26origin_type%3D3002070010%26product_id%3D3420911657696812285&bdp_log=%7B%22launch_from%22%3A%22full_screen_card%22%2C%22location%22%3A%22click_product%22%7D&bdpsum=bb62544", "order_url":"https://haohuo.jinritemai.com/views/product/buynow?id=3420911657696812285&product_id=3420911657696812285&origin_type=3002070010&origin_id=71105932077_3420911657696812285&disable_activity=0&group_id=0&alkey=1128_71105932077_0_3420911657696812285_010&new_source_type=product_detail&status_bar_color=ffffff&loading_bgcolor=ffffff&hide_nav_bar=1&status_font_dark=1", "origin_id":"71105932077_3420911657696812285", "origin_type":"3002070010", "shop_name":"涵胖胖大码女装", "virtual_promotion":{ "already_buy":false, "is":false } }, "user_shop_categories":null, "visitor":{ "avatar":[ { "uri":"100x100/30ebf0003c1e35fd0e1e5", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/30ebf0003c1e35fd0e1e5.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/30ebf0003c1e35fd0e1e5.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/30ebf0003c1e35fd0e1e5.jpeg?from=4010531038" ] }, { "uri":"100x100/tos-cn-avt-0015/0e9cff37376d21868799b6efa5b61a76", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-avt-0015/0e9cff37376d21868799b6efa5b61a76~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-avt-0015/0e9cff37376d21868799b6efa5b61a76~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-avt-0015/0e9cff37376d21868799b6efa5b61a76~c5_100x100.jpeg?from=4010531038" ] }, { "uri":"100x100/26e1400009f60609d0719", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/26e1400009f60609d0719.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/100x100/26e1400009f60609d0719.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/26e1400009f60609d0719.jpeg?from=4010531038" ] }, { "uri":"100x100/318c1000c282ce0281fd9", "url_list":[ "https://p26-dy.byteimg.com/aweme/100x100/318c1000c282ce0281fd9.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/318c1000c282ce0281fd9.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/318c1000c282ce0281fd9.jpeg?from=4010531038" ] }, { "uri":"100x100/f9540003473023bc8a0c", "url_list":[ "https://p9-dy.byteimg.com/aweme/100x100/f9540003473023bc8a0c.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/f9540003473023bc8a0c.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/f9540003473023bc8a0c.jpeg?from=4010531038" ] } ], "count":4658 } } ], "rows":[ { "id":1, "name":"我的", "number":66, "with_data":true }, { "id":2, "name":"举荐", "number":286, "with_data":false } ], "search_hint":"", "status_code":0, "status_msg":"" }, "msg":"success"}

November 18, 2020 · 2 min · jiezi

关于大数据:抖音Api用户关注列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户关注列表Api：申请Apihttp://主机地址/douyin/user/followings?token=xxx&uid=100000004548&cursor=1577594707000申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "extra":{ "fatal_item_ids":[ ], "logid":"2020091421494601002802214309181ADB", "now":1600091386890 }, "followings":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "accept_private_policy":false, "account_region":"", "apple_account":0, "authority_status":0, "avatar_168x168":{ "uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_168x168.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_168x168.webp?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_168x168.webp?from=4010531038" ] }, "avatar_300x300":{ "uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_300x300.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_300x300.webp?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_300x300.webp?from=4010531038" ] }, "avatar_larger":{ "uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_1080x1080.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_1080x1080.jpeg?from=4010531038" ] }, "avatar_medium":{ "uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_720x720.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_720x720.jpeg?from=4010531038" ] }, "avatar_thumb":{ "uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7030b6575bac4968a822669e457d26b5~c5_100x100.jpeg?from=4010531038" ] }, "avatar_uri":"tos-cn-i-0813/7030b6575bac4968a822669e457d26b5", "bind_phone":"", "bio_info_permission":0, "birthday":"2017-01-01", "birthday_hide_level":0, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":0, "cover_url":[ { "uri":"c8510002be9a3a61aad2", "url_list":[ "http://p1-dy.byteimg.com/obj/c8510002be9a3a61aad2", "http://p3-dy.byteimg.com/obj/c8510002be9a3a61aad2", "http://p3-dy.byteimg.com/obj/c8510002be9a3a61aad2" ] } ], "create_time":0, "custom_verify":"", "cv_level":"", "default_download_setting":0, "download_prompt_ts":0, "download_setting":0, "duet_setting":0, "enterprise_verify_reason":"CCTV-1《经典咏流传》节目官网抖音账号", "follow_status":0, "follower_status":0, "gender":2, "geofencing":[ ], "google_account":"", "has_email":false, "has_insights":false, "has_orders":false, "hide_location":false, "hide_search":false, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_gov_media_vip":false, "is_mirror":false, "is_phone_binded":false, "is_star_atlas":0, "is_verified":false, "language":"", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "need_recommend":0, "neiguang_shield":0, "nickname":"经典咏流传", "original_music_cover":null, "original_music_qrcode":null, "policy_version":[ ], "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAA-CA-lq0X19hfiIPG6wA19xuXTJre1JrQX2jVD79OgRg", "secret":0, "share_qrcode_uri":"80fa0024ca1dc388297d", "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"926253136", "signature":"文以载道，歌以咏志！", "special_lock":1, "status":1, "story_open":false, "twitter_id":"", "twitter_name":"", "type_label":[ 189, 6766427600769255000 ], "uid":"98297838633", "unique_id":"", "unique_id_modify_time":1550569152, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_rate_map":{ }, "verification_type":1, "verify_info":"", "video_icon":{ "uri":"", "url_list":[ ] }, "video_icon_virtual_URI":"", "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "with_commerce_entry":false, "with_fusion_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"" } ], "has_more":true, "hotsoon_has_more":0, "hotsoon_text":"", "log_pb":{ "impr_id":"2020091421494601002802214309181ADB" }, "max_time":1597329058, "min_time":1557925977, "myself_user_id":"0", "offset":0, "rec_has_more":false, "status_code":0, "total":27 }, "msg":"success"}

November 18, 2020 · 1 min · jiezi

关于大数据:抖音Api用户粉丝列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户粉丝列表Api：申请Apihttp://主机地址/douyin/user/followers?token=xxx&uid=100000004548&cursor=0申请形式GET参数字段类型阐明tokenstring接口受权码uidint用户idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "extra":{ "fatal_item_ids":[ ], "logid":"202009142151020100280680710A1CF23D", "now":1600091462958 }, "followers":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "accept_private_policy":false, "account_region":"", "apple_account":0, "authority_status":0, "avatar_168x168":{ "uri":"2e1ff00057231301091e1", "url_list":[ "https://p9-dy.byteimg.com/img/2e1ff00057231301091e1~c5_168x168.webp?from=4010531038", "https://p26-dy.byteimg.com/img/2e1ff00057231301091e1~c5_168x168.webp?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/2e1ff00057231301091e1~c5_168x168.webp?from=4010531038" ] }, "avatar_300x300":{ "uri":"2e1ff00057231301091e1", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/2e1ff00057231301091e1~c5_300x300.webp?from=4010531038", "https://p26-dy.byteimg.com/img/2e1ff00057231301091e1~c5_300x300.webp?from=4010531038", "https://p9-dy.byteimg.com/img/2e1ff00057231301091e1~c5_300x300.webp?from=4010531038" ] }, "avatar_larger":{ "uri":"2e1ff00057231301091e1", "url_list":[ "https://p29-dy.byteimg.com/aweme/1080x1080/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/2e1ff00057231301091e1.jpeg?from=4010531038" ] }, "avatar_medium":{ "uri":"2e1ff00057231301091e1", "url_list":[ "https://p26-dy.byteimg.com/aweme/720x720/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/720x720/2e1ff00057231301091e1.jpeg?from=4010531038" ] }, "avatar_thumb":{ "uri":"2e1ff00057231301091e1", "url_list":[ "https://p6-dy-ipv6.byteimg.com/aweme/100x100/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/2e1ff00057231301091e1.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/2e1ff00057231301091e1.jpeg?from=4010531038" ] }, "avatar_uri":"2e1ff00057231301091e1", "bind_phone":"", "bio_info_permission":0, "birthday":"", "birthday_hide_level":0, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":0, "cover_url":[ { "uri":"c8510002be9a3a61aad2", "url_list":[ "http://p1-dy.byteimg.com/obj/c8510002be9a3a61aad2", "http://p3-dy.byteimg.com/obj/c8510002be9a3a61aad2", "http://p3-dy.byteimg.com/obj/c8510002be9a3a61aad2" ] } ], "create_time":0, "custom_verify":"", "cv_level":"", "default_download_setting":0, "download_prompt_ts":0, "download_setting":0, "duet_setting":0, "enterprise_verify_reason":"", "follow_status":0, "follower_status":0, "gender":0, "geofencing":[ ], "google_account":"", "has_email":false, "has_insights":false, "has_orders":false, "hide_location":false, "hide_search":false, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_gov_media_vip":false, "is_mirror":false, "is_phone_binded":false, "is_star_atlas":0, "is_verified":false, "language":"", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "need_recommend":0, "neiguang_shield":0, "nickname":"我是大笨蛋", "original_music_cover":null, "original_music_qrcode":null, "policy_version":[ ], "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAAF4g0GM09sHOCFCyyiOfCnJ4ICKnhnb6Z8H-tbV7B0j4", "secret":0, "share_qrcode_uri":"2e1ff0005726d8c353243", "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"631858119", "signature":"", "special_lock":1, "status":1, "story_open":false, "twitter_id":"", "twitter_name":"", "type_label":[ ], "uid":"94723618311", "unique_id":"", "unique_id_modify_time":1550569152, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_rate_map":{ }, "verification_type":1, "verify_info":"", "video_icon":{ "uri":"", "url_list":[ ] }, "video_icon_virtual_URI":"", "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "with_commerce_entry":false, "with_fusion_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"" } ], "has_more":true, "hotsoon_has_more":0, "hotsoon_text":"", "log_pb":{ "impr_id":"202009142151020100280680710A1CF23D" }, "max_time":1600091460, "min_time":1600091429, "myself_user_id":"92913294066", "offset":0, "rec_has_more":false, "status_code":0, "total":96004297 }, "msg":"success"}

November 18, 2020 · 1 min · jiezi

关于大数据:抖音Api直播搜索列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音直播搜寻列表Api：申请Apihttp://主机地址/douyin/search/lives?token=xxx&keyword=热巴&cursor=20申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词cursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code": 200, "data": { "cursor": 12, "data": [ { "lives": { "anchors": null, "author": { "ad_cover_url": null, "avatar_larger": { "uri": "1080x1080/318820007c435e3fd4696", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "avatar_medium": { "uri": "720x720/318820007c435e3fd4696", "url_list": [ "https://p1-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/318820007c435e3fd4696", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "can_set_geofencing": null, "cha_list": null, "cover_url": null, "custom_verify": "", "enterprise_verify_reason": "", "followers_detail": null, "geofencing": null, "homepage_bottom_toast": null, "item_list": null, "need_points": null, "new_story_cover": null, "nickname": "南京迪丽热巴????", "platform_sync_info": null, "relative_users": null, "room_cover": { "uri": "webcast/6761373873079569163", "url_list": [ "http://p3-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image" ] }, "room_id": 6872334082282359552, "room_id_str": "6872334082282359552", "sec_uid": "MS4wLjABAAAAnGiirU7x9pMMMEdIqHn4ItxrggQ1G87HeWRX7GXWd_c", "short_id": "27648787", "type_label": null, "uid": "62256671560", "user_tags": null, "white_cover_url": null }, "aweme_id": "6872334082282359552", "aweme_type": 101, "cha_list": null, "challenge_position": null, "comment_list": null, "commerce_config_data": null, "cover_labels": null, "geofencing": null, "geofencing_regions": null, "group_id": "6872333965101960463", "hybrid_label": null, "image_infos": null, "interaction_stickers": null, "label_top_text": null, "long_video": null, "nickname_position": null, "origin_comment_ids": null, "position": null, "promotions": null, "rawdata": "{\"id\":6872334082282359552,\"id_str\":\"6872334082282359552\",\"status\":2,\"owner_user_id\":62256671560,\"title\":\"南京古力那扎????正在直\",\"user_count\":2,\"create_time\":1600089968,\"linkmic_layout\":1,\"cover\":{\"url_list\":[\"http://p3-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image\",\"http://p6-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image\"],\"uri\":\"webcast/6761373873079569163\",\"avg_color\":\"#DCF4FA\"},\"stream_url\":{\"id\":683840967322632337,\"id_str\":\"683840967322632337\",\"resolution_name\":{\"FULL_HD1\":\"蓝光\",\"HD1\":\"超清\",\"ORIGION\":\"原画\",\"SD1\":\"标清\",\"SD2\":\"高清\"},\"default_resolution\":\"ORIGION\",\"extra\":{\"height\":864,\"width\":480,\"fps\":15,\"max_bitrate\":900,\"min_bitrate\":300,\"default_bitrate\":800},\"rtmp_pull_url\":\"http://pull-flv-l11.douyincdn.com/stage/stream-683840967322632337.flv\",\"live_core_sdk_data\":{\"pull_data\":{\"stream_data\":\"{\\\"common\\\":{\\\"session_id\\\":\\\"000-202009142143070101450190863D1B7651\\\"},\\\"data\\\":{\\\"origin\\\":{\\\"main\\\":{\\\"flv\\\":\\\"http: //pull-flv-l11.douyincdn.com/stage/stream-683840967322632337.flv\\\",\\\"hls\\\":\\\"http: //pull-hls-l11.douyincdn.com/stage/stream-683840967322632337.m3u8\\\",\\\"cmaf\\\":\\\"\\\",\\\"dash\\\":\\\"\\\",\\\"sdk_params\\\":\\\"{ \\\\\\\"VCodec\\\\\\\": \\\\\\\"h265\\\\\\\", \\\\\\\"gop\\\\\\\": 4, \\\\\\\"resolution\\\\\\\": \\\\\\\"720x1280\\\\\\\", \\\\\\\"vbitrate\\\\\\\": 800000 }\\\"}}}}\",\"options\":{\"default_quality\":{\"name\":\"超清\",\"sdk_key\":\"origin\"}}}}},\"stats\":{\"total_user\":29},\"owner\":{\"id\":62256671560,\"short_id\":27648787,\"nickname\":\"南京迪丽热巴????\",\"gender\":2,\"signature\":\"想成为你的例外和偏爱\\n直播工夫 早晨9点半\\n微博：叫我么么\",\"level\":1,\"avatar_thumb\":{\"url_list\":[\"https://p9-dy.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p3-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p6-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"100x100/318820007c435e3fd4696\"},\"avatar_medium\":{\"url_list\":[\"https://p1-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p29-dy.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p3-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"720x720/318820007c435e3fd4696\"},\"avatar_large\":{\"url_list\":[\"https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p9-dy.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"1080x1080/318820007c435e3fd4696\"},\"verified\":true,\"city\":\"南京\",\"status\":1,\"modify_time\":1600004002,\"share_qrcode_uri\":\"24a200425361734ca144\",\"badge_image_list\":[{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\",\"http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_honor_level_icon_new_22.png\",\"height\":16,\"width\":32,\"image_type\":1}],\"follow_info\":{\"following_count\":51,\"follower_count\":70186},\"pay_grade\":{\"total_diamond_count\":7324,\"level\":22,\"this_grade_min_diamond\":6600,\"this_grade_max_diamond\":8600,\"grade_describe\":\"间隔23级还差1276抖币\",\"new_im_icon_with_level\":{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\",\"http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_honor_level_icon_new_22.png\",\"height\":16,\"width\":32,\"image_type\":1},\"new_live_icon\":{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_20_24.png~tplv-obj.image\",\"http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_20_24.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_pay_grade_2x_20_24.png\",\"height\":12,\"width\":12,\"image_type\":1},\"score\":7324},\"fans_club\":{\"data\":{\"badge\":{\"icons\":{\"0\":{}}}}},\"user_attr\":{},\"own_room\":{\"room_ids\":[6872334082282359552],\"room_ids_str\":[\"6872334082282359552\"]},\"pay_score\":7324,\"ticket_count\":1131426,\"link_mic_stats\":1,\"display_id\":\"TBB20\",\"sec_uid\":\"MS4wLjABAAAAnGiirU7x9pMMMEdIqHn4ItxrggQ1G87HeWRX7GXWd_c\",\"authorization_info\":3,\"id_str\":\"62256671560\"},\"video_feed_tag\":\"直播中\",\"content_tag\":\"语音互动\"}", "search_extra": { "current_time": 1600090987 }, "text_extra": null, "uniqid_position": null, "video_labels": null, "video_text": null }, "type": 1 } ], "extra": { "fatal_item_ids": [ ], "logid": "202009142143070101450190863D1B7651", "now": 1600090987000, "search_request_id": "" }, "guide_search_words": null, "has_more": 0, "log_pb": { "impr_id": "202009142143070101450190863D1B7651" }, "status_code": 0 }, "msg": "success"}

November 17, 2020 · 1 min · jiezi

关于大数据:抖音Api用户搜索列表

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户搜寻列表Api：申请Apihttp://主机地址/douyin/search/users?token=xxx&keyword=热巴&cursor=0申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词cursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "challenge_list":null, "cursor":20, "extra":{ "fatal_item_ids":[ ], "logid":"202009142125500100290281622318FBCD", "now":1600089951000, "search_request_id":"" }, "has_more":1, "input_keyword":"热巴", "log_pb":{ "impr_id":"202009142125500100290281622318FBCD" }, "music_list":null, "myself_user_id":"0", "qc":"", "rid":"202009142125500100290281622318FBCD", "status_code":0, "type":1, "user_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "challenges":null, "effects":null, "items":null, "mix_list":null, "musics":null, "position":null, "uniqid_position":null, "user_info":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"168x168/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.jpeg?from=2956013662" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"300x300/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.jpeg?from=2956013662" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"1080x1080/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.jpeg?from=2956013662" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"720x720/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.jpeg?from=2956013662" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"100x100/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.jpeg?from=2956013662" ], "width":720 }, "avatar_uri":"tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "aweme_count":0, "bind_phone":"", "birthday":"2000-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":9, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":214, "fb_expire_time":0, "follow_status":0, "follower_count":6800, "follower_status":0, "followers_detail":null, "following_count":4, "gender":2, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":false, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"热巴", "original_musician":{ "digg_count":0, "music_count":0, "music_used_count":0 }, "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "room_id_str":"0", "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAA8vLHIRsiLyt-0m06Dvz0KuqkK3CfRSz2rytmFwrR39I", "secret":0, "share_info":{ "share_desc":"", "share_desc_info":"", "share_qrcode_url":{ "height":720, "uri":"8d740001ca53dfac4162", "url_list":[ "https://p6-dy-ipv6.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662", "https://p3-dy-ipv6.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662", "https://p9-dy.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "share_qrcode_uri":"8d740001ca53dfac4162", "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"1037063419", "show_image_bubble":false, "signature":"爱本人♥", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":17330, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"98803352045", "unique_id":"daba1314", "unique_id_modify_time":1600089951, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"" } } ] }, "msg":"success"}

November 17, 2020 · 2 min · jiezi

关于大数据:抖音直播数据6

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口：抖音直播随机举荐申请Apihttp://主机地址/douyin/liveroom/feed?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "data":[ { "AnchorABMap":{ }, "admin_user_ids":[ 99861659499, 52271736462, 1011196253964014, 96403313823, 101799896778, 103146623893, 105895303173, 2084292323972430, 1103515168282891, 106708685343 ], "anchor_scheduled_time_text":"", "anchor_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "anchor_tab_type":0, "app_id":0, "auto_cover":0, "base_category":0, "book_end_time":0, "book_time":0, "business_live":0, "category":0, "cell_style":3, "challenge_info":"", "client_version":120400, "comment_box":{ "placeholder":"说点什么..." }, "comment_name_mode":0, "common_label_list":"", "content_tag":"语音互动", "cover":{ "avg_color":"#A3A3CC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/6825919466414000909", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image" ], "width":0 }, "create_time":1600093069, "deco_list":[ ], "distance":"", "distance_city":"", "distance_km":"", "dynamic_cover_dict":{ }, "dynamic_cover_uri":"", "enable_room_perspective":true, "fansclub_msg_style":0, "fcdn_appid":0, "feed_room_label":{ "avg_color":"#E0D4BC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/2ea90002aca1159b5c67", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image" ], "width":0 }, "finish_reason":0, "finish_time":1600096193, "finish_url":"", "follow_msg_style":0, "forum_extra_data":"", "gift_msg_style":0, "group_id":0, "group_source":22, "guide_button":{ "avg_color":"#7A5353", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_button_togather_3x.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image" ], "width":0 }, "has_commerce_goods":true, "hot_sentence_info":"", "id":6872347400942570254, "id_str":"6872347400942570254", "introduction":"", "is_replay":false, "is_show_inquiry_ball":false, "is_show_user_card_switch":true, "last_ping_time":0, "layout":0, "like_count":92949, "linker_map":{ }, "linkmic_layout":1, "live_distribution":[ ], "live_id":1, "live_type_audio":false, "live_type_linkmic":false, "live_type_normal":true, "live_type_official":false, "live_type_sandbox":false, "live_type_screenshot":false, "live_type_third_party":false, "living_room_attrs":{ "admin_flag":0, "rank":0, "room_id":6872347400942570254, "room_id_str":"6872347400942570254", "silence_flag":0 }, "location":"", "lottery_finish_time":0, "luckymoney_num":0, "mosaic_status":0, "mosaic_tip":"", "orientation":0, "os_type":1, "owner":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authentication_info":{ "authentication_badge":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/authentication_icon.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width":0 }, "custom_verify":"抖音音乐人", "enterprise_verify_reason":"" }, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/3109c00018629796e0bbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"上海", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"hanyu8866", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":88159, "following_count":272, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":53116625314, "id_str":"53116625314", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600095187, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"君少????", "own_room":{ "room_ids":[ 6872347400942570000 ], "room_ids_str":[ "6872347400942570254" ] }, "pay_grade":{ "grade_banner":"", "grade_describe":"间隔11级还差76抖币", "grade_icon_list":[ ], "level":10, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_10_14.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":234, "screen_chat_type":0, "this_grade_max_diamond":310, "this_grade_min_diamond":230, "total_diamond_count":234, "upgrade_need_consume":0 }, "pay_score":234, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA3MeJAw6E5g0nxsRGlIwlHEVyhjGYcZPQST_y4Zqt9xw", "secret":0, "share_qrcode_uri":"671000112a883c693062", "short_id":379542891, "signature":"????开播工夫：晚21:00～2:00 (偶然提早请谅解下）????直播内容: 唱歌, 风趣, 老歌, 新歌, 心灵, 情感生活..????酷????搜君少 关注下哈, 惟一抖音号其余假冒非自己????身高182:体重135:保持做个好的操行内外兼修的人????小视频全副自己现录现场, 5级粉丝团➕V❤V????", "special_id":"", "status":1, "telephone":"", "ticket_count":52070102, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":true, "with_fusion_shop_entry":true }, "owner_device_id":0, "owner_user_id":53116625314, "popularity":0, "popularity_str":"", "pre_enter_time":0, "preview_copy":" 昨天擦肩而过，明天不再错过~", "preview_flow_tag":0, "private_info":"", "ranklist_audience_type":0, "real_distance":"", "relation_tag":"", "replay":true, "replay_location":0, "room_audit_status":0, "room_auth":{ "AudioChat":0, "Banner":1, "Chat":true, "CommerceCard":1, "Danmaku":false, "DanmakuDefault":1, "Digg":true, "DonationSticker":2, "Gift":true, "GiftAnchorMt":1, "HourRank":0, "Landscape":1, "LandscapeChat":1, "LuckMoney":true, "MoreAnchor":1, "POI":true, "Props":true, "PublicScreen":1, "RecordScreen":2, "RoomContributor":true, "Share":1, "UserCard":true, "UserCorner":1 }, "room_create_ab_param":"", "room_layout":0, "room_tabs":[ ], "room_tag":0, "scroll_config":"", "search_id":0, "sell_goods":false, "share_msg_style":0, "share_url":"https://webcast.amemv.com/webcast/reflow/6872347400942570254", "short_title":"", "short_touch_area_config":{ "elements":{ "1":{ "priority":0, "type":1 }, "2":{ "priority":0, "type":2 }, "3":{ "priority":0, "type":3 }, "4":{ "priority":2, "type":4 }, "5":{ "priority":3, "type":5 }, "6":{ "priority":2, "type":6 }, "7":{ "priority":2, "type":7 }, "8":{ "priority":2, "type":8 }, "9":{ "priority":2, "type":9 }, "10":{ "priority":2, "type":10 }, "12":{ "priority":2, "type":12 } } }, "stamps":"", "start_time":0, "stats":{ "digg_count":0, "dou_plus_promotion":"", "enter_count":0, "fan_ticket":35487, "follow_count":130, "gift_uv_count":114, "id":6872347400942570254, "id_str":"6872347400942570254", "like_count":0, "money":0, "total_user":19291, "total_user_desp":"", "user_count_composition":{ "city":0, "my_follow":0.02, "other":0.54, "video_detail":0.43 }, "watermelon":0 }, "status":2, "stream_close_time":0, "stream_id":107380421578457227, "stream_id_str":"107380421578457227", "stream_provider":0, "stream_url":{ "candidate_resolution":[ ], "complete_push_urls":[ ], "default_resolution":"ORIGION", "extra":{ "anchor_interact_profile":0, "audience_interact_profile":0, "bframe_enable":false, "bitrate_adapt_strategy":0, "bytevc1_enable":false, "default_bitrate":800, "fps":15, "gop_sec":0, "h265_enable":false, "hardware_encode":false, "height":1280, "max_bitrate":1333, "min_bitrate":512, "roi":false, "sw_roi":false, "video_profile":0, "width":720 }, "flv_pull_url":{ }, "flv_pull_url_params":{ }, "hls_pull_url":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8", "hls_pull_url_map":{ }, "hls_pull_url_params":"{"VCodec":"h264"}", "id":107380421578457227, "id_str":"107380421578457227", "live_core_sdk_data":{ "pull_data":{ "options":{ "default_quality":{ "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" }, "qualities":[ { "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" } ] }, "stream_data":"{"common":{"session_id":"037-202009142310030100120330321750DAD3"},"data":{"origin":{"main":{"flv":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv","hls":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8","cmaf":"","dash":"","sdk_params":"{\"VCodec\":\"h264\",\"gop\":4,\"resolution\":\"or4\",\"vbitrate\":0}"}}}}" } }, "provider":0, "push_urls":[ ], "resolution_name":{ "FULL_HD1":"蓝光", "HD1":"超清", "ORIGION":"原画", "SD1":"标清", "SD2":"高清" }, "rtmp_pull_url":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv", "rtmp_pull_url_params":"{"VCodec":"h264"}", "rtmp_push_url":"", "rtmp_push_url_params":"", "stream_control_type":0 }, "sun_daily_icon_content":"", "tags":[ ], "title":"人帅歌美☘️正能量", "top_fans":[ { "fan_ticket":10400, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"dyru1g558bhr", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":57, "following_count":31, "push_status":0 }, "follow_status":0, "gender":2, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":1103515168282891, "id_str":"1103515168282891", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1599832509, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"雅玉", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔46级还差50.0w抖币", "grade_icon_list":[ ], "level":45, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_45_49.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":4000225, "screen_chat_type":0, "this_grade_max_diamond":4500000, "this_grade_min_diamond":3400000, "total_diamond_count":4000225, "upgrade_need_consume":0 }, "pay_score":4000225, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA1iOTCLUnU0ltsnYC-NIh3dIkse2of0cgJxeM9w7P102k8xK4TtEeAvyAnSg6hOys", "secret":1, "share_qrcode_uri":"31166000284aa5924b352", "short_id":3589316171, "signature":"我不能扭转生命的长度，但我能够把握生命的宽度！ 断、舍、离。 断：把不高兴的所有事件从脑海里删除。 舍：把心里面的垃圾定期的解决掉。 离：放过本人放空本人，才会有机会贮存高兴的空间。", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } }, { "fan_ticket":9810, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_26.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"阜阳", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"2020LZ312", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":25, "following_count":13, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":338271925708148, "id_str":"338271925708148", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600016197, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"爱是你我????", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔27级还差1896抖币", "grade_icon_list":[ ], "level":26, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_26.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_25_29.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_25_29.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_25_29.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":24104, "screen_chat_type":0, "this_grade_max_diamond":26000, "this_grade_min_diamond":20000, "total_diamond_count":24104, "upgrade_need_consume":0 }, "pay_score":24104, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA-VVOcT--EkEqdZ1ujrsoNOzCqJsr75ldIM1q9I2mN7Q", "secret":0, "share_qrcode_uri":"30f3d00063f1241f256c4", "short_id":3585086691, "signature":"", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } }, { "fan_ticket":4037, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_35.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"深圳", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"1904315900lfy", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":253, "following_count":443, "push_status":0 }, "follow_status":0, "gender":2, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":96248386555, "id_str":"96248386555", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600064506, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"ꦿ君❤️兒ℒℴℯ", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔36级还差5.0w抖币", "grade_icon_list":[ ], "level":35, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_35.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_35_39.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_35_39.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_35_39.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":250001, "screen_chat_type":0, "this_grade_max_diamond":300000, "this_grade_min_diamond":230000, "total_diamond_count":250001, "upgrade_need_consume":0 }, "pay_score":250001, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAAfNrqgs8FZmDYp6bFp_Ii4SWarXEmTaTohw2OpTwK_5o", "secret":0, "share_qrcode_uri":"2f18e000017540a8d1d9a", "short_id":3481572764, "signature":"陪着你，看着你，想着你，爱着你∽", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } } ], "use_filter":false, "user_count":1083, "user_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "vertical_cover_uri":"", "vid":"", "video_feed_tag":"直播中", "wait_copy":"失去急躁的期待将幸福擦肩而过", "web_count":0, "webcast_comment_tcs":0, "webcast_sdk_version":0, "with_draw_something":false, "with_ktv":false, "with_linkmic":false }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "extra":{ "now":1600096204128 }, "status_code":0 }, "msg":"success"}

November 15, 2020 · 7 min · jiezi

关于大数据:抖音直播数据5

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口：直播在线观众申请Apihttp://主机地址/douyin/liveroom/audience?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": { "currency": "音浪", "has_more": false, "has_once_live": true, "music_wave": "音浪", "ranks": [ { "delta": 0, "first_gift": false, "gap_description": "99", "rank": 1, "score": 99, "user": { "adversary_authorization_info": 0, "adversary_user_status": 0, "allow_be_located": false, "allow_find_by_contacts": false, "allow_others_download_video": false, "allow_others_download_when_sharing_video": false, "allow_share_show_profile": false, "allow_show_in_gossip": false, "allow_show_my_action": false, "allow_strange_comment": false, "allow_unfollower_comment": false, "allow_use_linkmic": false, "authorization_info": 3, "avatar_thumb": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "100x100/316e3000c72bee4420e2d", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038" ], "width": 0 }, "badge_image_list": [], "bg_img_url": "", "birthday": 0, "birthday_description": "", "birthday_valid": false, "block_status": 0, "city": "", "comment_restrict": 0, "commerce_webcast_config_ids": [], "constellation": "", "create_time": 0, "disable_ichat": 0, "display_id": "385190430", "enable_ichat_img": 0, "exp": 0, "experience": 0, "fan_ticket_count": 0, "fans_club": { "data": { "anchor_id": 0, "available_gift_ids": [], "badge": { "icons": { "0": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "", "url_list": [], "width": 0 } }, "title": "" }, "club_name": "", "level": 0, "user_fans_club_status": 0 }, "prefer_data": {} }, "fold_stranger_chat": false, "follow_info": { "follow_status": 0, "follower_count": 0, "following_count": 0, "push_status": 0 }, "follow_status": 0, "gender": 0, "hotsoon_verified": false, "hotsoon_verified_reason": "", "ichat_restrict_type": 0, "id": 66287019758, "id_str": "66287019758", "income_share_percent": 0, "is_follower": false, "is_following": false, "level": 0, "link_mic_stats": 0, "media_badge_image_list": [], "modify_time": 0, "need_profile_guide": false, "new_real_time_icons": [], "nickname": "吉森", "pay_grade": { "grade_banner": "", "grade_describe": "间隔17级还差3抖币", "grade_icon_list": [], "level": 16, "name": "", "new_im_icon_with_level": { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_16.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image" ], "width": 32 }, "new_live_icon": { "avg_color": "", "height": 12, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_pay_grade_2x_15_19.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image" ], "width": 12 }, "next_diamond": 0, "next_name": "", "next_privileges": "", "now_diamond": 0, "pay_diamond_bak": 0, "score": 1697, "screen_chat_type": 0, "this_grade_max_diamond": 1700, "this_grade_min_diamond": 1300, "total_diamond_count": 1697, "upgrade_need_consume": 0 }, "pay_score": 0, "pay_scores": 0, "push_comment_status": false, "push_digg": false, "push_follow": false, "push_friend_action": false, "push_ichat": false, "push_status": false, "push_video_post": false, "push_video_recommend": false, "real_time_icons": [], "sec_uid": "MS4wLjABAAAABkK4jcEax0iVyUVnrSH3Q63wM6vRb_OlpK0Zd9DbcwE", "secret": 0, "share_qrcode_uri": "", "short_id": 385190430, "signature": "", "special_id": "", "status": 0, "telephone": "", "ticket_count": 0, "top_fans": [], "top_vip_no": 0, "total_recharge_diamond_count": 0, "user_role": 0, "verified": false, "verified_content": "", "verified_mobile": false, "verified_reason": "", "with_car_management_permission": false, "with_commerce_permission": false, "with_fusion_shop_entry": false } }, ], "rules_url": "sslocal://webcast_webview?url=https%3A%2F%2Faweme.snssdk.com%2Fmagic%2Fpage%2Fejs%2F5f27c6ca9950ec0307de9248%3FappType%3Ddouyin%26pull_down_indicator_color%3Ddark%26pull_down_indicator_not_show%3D0%26web_bg_color%3D%2523ffffffff&pull_down_close=0&pull_down_indicator_not_show=1&pull_down_indicator_color=dark&type=popup&gravity=bottom&height=450&radius=8&hide_more=0&hide_nav_bar=0&hide_status_bar=0&landscape_custom_width=1&rate_height=450", "seats": [], "self_info": { "delta": 0, "first_gift": false, "gap_description": "本场奉献：0音浪", "rank": 0, "score": 0 }, "total": 0 }, "extra": { "now": 1600957337628 }, "status_code": 0 }, "msg": "success"}

November 15, 2020 · 2 min · jiezi

关于大数据:抖音直播数据4

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口：直播商品列表申请Apihttp://主机地址/douyin/liveroom/promotions?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code":200, "data":{ "current_promotion_id":"3436129527946972390", "entries":[ { "icon":"http://p3.pstatp.com/origin/321f50008dae87efe41ce", "title":"订单", "type":2, "url":"aweme://webview/?url=https%3A%2F%2Faweme.snssdk.com%2Ffalcon%2Fe_commerce%2Frn%2Forder_dashboard%2F%3Fstatus_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26enter_from%3Dlive_list_card%26origin_type%3D9902106000&status_font_dark=0&hide_nav_bar=1&loading_bgcolor=161823&should_full_screen=1&enter_from=live_list_card&origin_type=9902106000&rn_schema=aweme%3A%2F%2Freactnative%2F%3Fmodule_name%3Dpage_order_dashboard%26status_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26channel%3Dfe_lyon_order_dashboard%26bundle%3Dindex.js%26enter_from%3Dlive_list_card%26origin_type%3D9902106000" } ], "expire_time":300000, "flash_total":0, "has_more":false, "min_refresh_gap":10000, "next_page_id":"", "promotions":[ Object{...}, { "app_type":0, "app_url":"", "apply_coupon":0, "button_label":"去购买", "campaign":false, "can_explain":true, "can_seckill":false, "cos_fee":0, "cos_ratio":0, "coupons":[ ], "cover":"https://sf6-ttcdn-tos.pstatp.com/img/temai/4d79a9bc80b64c9ffd9412fc45f59c9bwww850-850~tplv-resize:200:0.webp", "detail_url":"aweme://goods/seeding/?promotion_id=3436129527946972390&product_id=3436129527946972390&target_uid=3773170526723102&item_id=0&source_page=live&sec_target_uid=MS4wLjABAAAAtvPLMdtyUwsz7C5mYnFRnpVzkJTC4k_AGxjfPhzu8dWQymu9_lzXPHMXp1q5gnGj&meta_param={"enter_from":"live","live_room_id":"6872323400263797518"}&carrier_type=&entrance_info=", "elastic_title":"", "event_param":{ }, "extra":{ "coupon_min_price":"0", "start_time":"0" }, "flash_icon":"", "flash_type":0, "in_stock":true, "index":2, "item_type":6, "label_icon":"https://sf1-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/explain_new.png", "min_price":5990, "next_page":"split", "order_url":"", "platform":4, "platform_icon":"https://sf6-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/platform_xiaodian.png", "platform_label":"小店", "price":99900, "product_id":"3436129527946972390", "promotion_id":"3436129527946972390", "promotion_source":[ ], "sale_num":0, "shop_id":3494225, "short_half_url":"", "short_title":"", "skip_style":0, "status":2, "stock_num":0, "title":"k00006三色显瘦牛仔裤" }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "room_type":0, "show_begin_time":0, "show_duration":0, "status_code":0, "status_msg":"", "top_limit":100, "total":31 }, "msg":"success"}

November 14, 2020 · 1 min · jiezi

关于大数据:抖音直播数据3

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口：直播开播查问申请Apihttp://主机地址/douyin/liveroom/status?token=xxx&room_id=6843198199583378191,6872323400263797518申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": [ { "alive": false, "room_id": 6843198199583378191 }, { "alive": true, "room_id": 6872323400263797518 } ], "extra": { "now": 1600096174925 }, "status_code": 0 }, "msg": "success"}

November 14, 2020 · 1 min · jiezi

关于大数据:什么是麒麟kylin查数据贼快的哟

前言微信搜【Java3y】关注这个有幻想的男人，点赞关注是对我最大的反对！文本已收录至我的GitHub：https://github.com/ZhongFuCheng3y/3y，有300多篇原创文章，最近在连载面试和我的项目系列！ 明天想跟大家一起入门一下kylin（麒麟）。 因为工作须要，前段时间对kylin简略入了个门，当初来写写笔记（我的文字或者能帮忙到你入门kylin，至多看完这篇应该能晓得kylin是干什么的）。 不多BB，开始吧 kylin介绍kylin是咱们国人主导并奉献到Apache基金会的开源我的项目，所以咱们会有中文文档学习： http://kylin.apache.org/cn/从官网咱们能够看到对kylin的介绍：Apache Kylin™是一个开源的、分布式的剖析型数据仓库，提供Hadoop/Spark 之上的SQL查问接口及多维分析（OLAP）能力以反对超大规模数据，最后由 eBay 开发并奉献至开源社区，它能在亚秒内查问微小的表。 看到这个介绍，只能用两个字来形容kylin：牛逼????。那牛逼在哪呢？上面再说 第一眼看过来，可能有的同学不晓得OLAP是什么货色，我上面来简略解释一下吧。（Hadoop/Spark/SQL/大数据这些词天天能看见，即使不懂它的原理，你都晓得这些货色是有什么用，是用来干嘛的，对吧？） 看到OLAP就不得不提它的兄弟OLTP，咱们简略来看看他们的全称和翻译的中文是什么： OLTP：On-Line Transaction Processing（联机事务处理）OLAP：On-Line Analytical Processing（联机剖析解决）中文的翻译咱们怕是看不懂的了，但咱们能够发现他俩的区别一个是「事务」，一个是「剖析」 从利用层面看，咱们能够简略地认为：OLTP次要用于业务零碎，对事务的要求比拟高，例如下单/交易（银行转账等业务）。OLAP次要用于数据仓库零碎，反对简单的剖析操作，偏重决策反对，并且提供直观易懂的查问后果。 我再画张思维导图图来给大家看一下，根本就懂了： 看到这里，你应该对OLAP有个根本的理解了。那再回到下面那句话：多维分析（OLAP）能力以反对超大规模数据，你第一反馈会想到什么？ 三歪第一反馈想到的就是Hive（Hive底层是HDFS：反对超大规模的数据）。 那既然说到Hive了，你会发现kylin前半段话，Hive如同简直都能够反对，但除了最初一句「它能在亚秒内查问微小的表」。 没错，到这里就能够晓得kylin的用处了：它能够在亚秒内查问微小的表，来实现数据分析和决策 每次跑Hive咱们可能都得跑几分钟（像我SQL写得烂的，跑半小时也是常常有的事），咱们从业务上就心愿用来剖析的数据能够跑得更快，反对这种需要的kylin就火????起来了。 我以Hive来引申kylin，除了kylin就没其余抉择了吗？那显然不是的。 当年我刚进公司的时候，吐槽Hive跑得太慢了，隔壁的小哥就通知我：你用presto啊，咱们大数据平台都反对的。 OLAP所提供的工具框架还是很多的，上面咱们来简略认识一下吧 家喻户晓，执行Hive实际上是跑Map-Reduce工作去HDFS拿数据。执行的过程波及到计算和存储。 有的人感觉Hive跑Map-Reduce计算这个过程太慢了，所以就不必Map-Reduce，用别的计算引擎，比方用MPP架构来跑，但存储没变... 有的人感觉，存储在HDFS去拿数据太慢了，改个存储的中央，不从HDFS拿... 有的人感觉，这啥破玩意，计算和存储我都改了，用我的框架一站式给你解决掉... 有的人感觉，Hadoop生态还是能够的，我先聚合一把，你查的时候间接拿聚合后的数据，也是很快的... 因为每个公司的业务场景和背景不一样，每个OLAP框架的短处也不一样，所以当初有如此多的OLAP技术在发光发热... Kylin入门从后面咱们曾经晓得为什么会呈现如此多的OLAP的技术了，从实质上来说就是咱们心愿剖析的数据能够让咱们查得更快，而kylin是这些技术其中的一员。 从上图也能够看到kylin是齐全依赖Hadoop生态的，那kylin是怎么实现提速的呢？答案就是：预聚合 假如咱们从MySQL检索日期大于2020-10-20的所有数据，只有咱们在日期列加上索引，能够很快就能查出相干的数据。 但如果咱们从MySQL检索日期大于2020-10-20的所有数据且每个用户在这段时间内生产了多少钱且xxxx，只有数据量大，不管你怎么建索引，查问的速度就不尽人意了。 那如果我按天的维度先做好对每个用户的统计，写到一张表中，等到用户按日期检索的时候是不是就很快了（因为我曾经按天聚合了一次数据，这张表比起原来的原始表数量会大大减少） kylin就是用预聚合这种思路来进步查问的速度，使它能够在亚秒内实现查问响应。 那咱们应用kylin的步骤是什么？官网曾经帮咱们解答了： 定义数据集上的一个星形或雪花形模型在定义的数据表上构建cube应用规范 SQL 通过 ODBC、JDBC 或 RESTFUL API 进行查问，仅需亚秒级响应工夫即可取得查问后果下面几个步骤，可能你不太理解的几个词有以下 星形模型、雪花模型、cube，上面我来简略解释一下： 在数据仓库畛域上，咱们的主表叫做事实表，事实表外键依赖的表叫做维度表。 「星形模型」：所有的维度表都直连到事实表。（上图） 「雪花形模型」：当有一个或多个维度表没有间接连贯到事实表上，而须要通过其余维表连贯到事实表（下图） 在kylin里，剖析数据的角度叫做「维度」，被剖析的指标叫做「度量」 好了，咱们再来看看cube是什么意思吧： 一个多维数据集称为一个OLAP Cube：下面的几张二维表咱们能够造成一个数据立方体，这个数据立方体就是Cube ...

November 13, 2020 · 1 min · jiezi

关于大数据:抖音直播数据1

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口：弹幕、关注、送礼、点赞、来了 实时获取申请Apihttp://主机地址/douyin/liveroom/chat?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": [ { "type": "WebcastSocialMessage", "nickname": "薛莲", "uid": "111265487875", "short_id": "2072651305", "msg_id": "6843261579299965709", "sec_uid": "\"MS4wLjABAAAAmpM-hJ8AeUM8hSc3w5YlY8Q2ZUaiEu7uvt6cApLkyjg\"", "msg": "关注了主播" }, { "type": "WebcastMemberMessage", "nickname": "用户5121651744892", "uid": "3654415794833197", "short_id": "2980367364", "msg_id": "6843261580051155719", "sec_uid": "\"MS4wLjABAAAAYcAoC-U8hSeyUxnGx_i5yoHRPPfwtr2wfplWg9KGsSMXyi7pWlPMV6XwMX7xpDgK\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "大姑", "uid": "3091436132641739", "short_id": "2372670321", "msg_id": "6843261580789320462", "sec_uid": "\"MS4wLjABAAAAws0M9rKV7kK1ayWZ31Ebjsd8SwFI0rdf8goPY7HI8tELNK1XkFpX25yvHqe8WY9d\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "我有一个好名字", "uid": "98675983627", "short_id": "1144452894", "msg_id": "6843261580508433159", "sec_uid": "\"MS4wLjABAAAAQhMqocOlzOLFvUE0tJKLQWKx1QuP8YXQmI2A6L3kWLQ\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "李祥林", "uid": "2946292105354829", "short_id": "3496282621", "msg_id": "6843261585180560136", "sec_uid": "\"MS4wLjABAAAAcFKemBUvCP-CppApJZsS_4FEuIAWf2_2fpyrcsrs1PZi4U0PyXOK-3qRy4dVnAWW\"", "msg": "来了" }, { "type": "WebcastChatMessage", "uid": "4006248980690445", "tid": "6843260054435826435", "nickname": "幸福", "text": "我不会买", "sec_uid": "MS4wLjABAAAAZWY-mQkfFitGRzNztj2FwNI6EJL6VJhEwuy3ehDmsVNBst1E2dU4umtJKmX4VW5S", "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2dbd70006de205b08161b.jpeg?from=4010531038" }, { "type": "WebcastMemberMessage", "nickname": "双子座一半天使，一半恶魔的陈欣彤????????", "uid": "945180703722141", "short_id": "2789104616", "msg_id": "6843261584941288205", "sec_uid": "\"MS4wLjABAAAAwvMatTP6mPsnysD0IPVmALci4CsfvRgOUi7lJxzq-c8\"", "msg": "来了" } ], "msg": 'success'}

November 13, 2020 · 1 min · jiezi

关于大数据:抖音直播数据弹幕商品在线观众随机推荐

抖音视频Api、抖音直播Api、抖音评论采集、抖音弹幕采集、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析抖音直播数据、抖音数据采集、抖音直播监控TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口直播间信息参数参数类型阐明tokenstring接口受权码room_idint直播间的room_id返回示例请分割：TiToData直播间 弹幕/关注/送礼/点赞/来了 实时获取参数参数类型阐明tokenstring接口受权码room_idint直播间的room_id返回示例请分割：TiToData直播间带货商品列表参数参数类型阐明tokenstring接口受权码room_idint直播间的room_id返回示例请分割：TiToData直播间开播查问参数参数类型阐明tokenstring接口受权码room_idint直播间的room_id返回示例请分割：TiToData直播间在线观众参数参数类型阐明tokenstring接口受权码room_idint直播间的room_id返回示例请分割：TiToData直播间随机举荐参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData

November 13, 2020 · 1 min · jiezi

关于大数据:再拔头筹FusionInsight为华为云大数据打造硬实力

摘要：在IDC2020大数据报告中，有云服务厂商、传统ICT 厂商，以及大数据时代的创企等三类“玩家”，为何华为云可能怀才不遇？近日，IDC公布《IDC MarketScape: 中国大数据管理平台厂商评估，2020》报告。该报告从能力、市场、策略三大维度对中国支流大数据厂商进行全面评估，报告显示华为云位居“领导者(Leaders)”象限，并在市场份额和技术实力两个维度双当先。 能够看到，在IDC大数据报告中，有云服务厂商、传统ICT 厂商，以及大数据时代的创企等三类“玩家”。为何华为云可能怀才不遇？ 解读华为云FusionInsight智能数据湖五大硬核能力据理解，华为云FusionInsight智能数据湖五大硬核能力凸显了翻新技术。 硬核能力一：让政企客户在一个大、快、融、稳的数据湖架构下可继续演进！ 大：传统的大数据单集群扩容受限，往往扩容到2000节点就难以冲破，华为云FusionInsight通过大集群冲破扩展性瓶颈，反对最大2万+节点大集群，还可集群联邦有限扩容。此大规模个性已在华为外部取得了实际，华为云流程IT通过FusionInsight构建OneData大数据集群，其规模已至1万+节点，撑持各部门经营剖析、即席查问等大数据分析，每日新增数据近100TB，10万张表，即席查问工作日均1万+，批处理作业每日10万+。华为流程IT OneData大集群历经两次滚动降级，业务0中断，已稳固运行六年。 快：因数据量仍在一直指数级增长，人们对大数据高效解决的极致谋求永无止境！传统大数据存在剖析链路长，以T+1预先报表为主。华为云FusionInsight MRS可T+0实时增量更新和实时OLAP，让大数据越用越”快“！华为团体IT基于FusionInsight，实现了CDC+FLINK的实时集成计划，撑持了骨干交易、财经、供给等交易数据的增量整合模型落地，绝对于传统数仓的ETL+调度计划，数据供应效率晋升了10倍。 融：传统大数据分析面临类型多、散布散、协同难等问题；FusionInsight通过HetuEngine实现五大交融，对立SQL接口仅用简略的SQL就可操作PB级数据，全民BI，让大数据越用越简略。某行基于FusionInsight构建金融大数据，通过HetuEngine对立SQL接口，解决数据扩散，组件多、语言多等难题，升高技术开发门槛，跨源跨域跨引擎交融剖析，数据免搬迁，升高整体TCO。 稳：FusionInsight可保障一企一湖连续性，在线滚动降级，业务永远在线，无需拆集群、搬利用，彻底解决传统大数据集群多、效率低、治理难、降级难等问题，让降级过程中要害业务不中断，确保业务连续性。某运营商应用FusionInsight搭建了大数据平台应答5G数据浪涌，先后两次滚动降级实现了大数据平台的平滑演进，实现业务无中断，降级无感知，用户体验继续在线，单集群规模已扩大至1500+节点，撑持了各类政务、游览、精准扶贫等200+大数据应用服务，笼罩用户1.3亿+。 硬核能力二：实时数据湖 为了实现实时性，华为云FusionInsight提出了实时数据湖， 反对数据实时批量入湖、实时增量同步，全量数据供给效率T+0；可对贴源数据实时多维分析，缩短剖析链路，进步剖析效率，让数据价值近在眼前！ 硬核能力三：云原生数据湖 近几年，云原生是云计算畛域要害的技术创新，华为云在云原生畛域也摸索多年，通过Data Lake Catalog数据湖目录，为超大规模剖析引擎提供对立元数据服务，让数据全局可视可得；在数据存储方面，通过OBS存算拆散计划，实现计算、存储按需扩容，基于企业级EC实现最低1.2正本，总体TCO降落20%+，让数据每bit老本更优。 湖内提供交互式剖析引擎，可无缝对接BI报表和自助剖析，实现秒级用数，数据免搬迁；湖内对立SQL接口，升高技术开发门槛，简化用数，实现技术当先的云原生数据湖。 硬核能力四：企业级数据仓库 华为云FusionInsight为客户提供基于Shared-Nothing架构提供新一代凋谢的、全场景剖析型数据仓库DWS，反对2048节点扩大能力；多层级全并行计算引擎，可调度海量的算力资源，通过高效的指令效率，实现数据导入和剖析；具备多层级容灾能力，稳固牢靠，离线、半在线、在线扩容技术，从容应对多种扩容场景。 硬核能力五：一站式数据湖治理核心 华为云FusionInsight为客户提供一站式数据湖治理核心，助力企业疾速构建从数据接入到剖析的E2E数据治理体系，对立数据规范，减速数据资产化。通过全域数据视图对立信息架构，对立数据规范；通过一站式全栈平台实现30+异构数据源的高效数据集成；领有凋谢齐备的平安体系，数据分级分类，对立平安认证。 通过以上五大“硬核”能力的加持，华为云FusionInsight新一代的数据湖，让大数据越用越快、越用越易、越用越稳、越用越省！ 技术产品好不好，要用案例来谈话事实上，华为云这种“稳固第一”的体现，在很多权威榜单中也有体现，例如间断四年上榜工信部中国大数据企业50强，间断三年入围Gartner Magic Quadrant for Data Management Solutions for Analytics，在中国区厂商排名第一。 在技术受到权威机构认可的同时，华为云FusionInsight也是“最懂行”的大数据解决方案。截至 2020 年 6 月底，华为云大数据已服务了 60+个国家和地区、3000+客户，笼罩政府、金融、运营商、电力、医疗、制作、互联网等泛滥行业。 在政府畛域，国内50%的智慧城市都有华为云FusionInsight的手不释卷的身影，华为云大数据已撑持多个部委和各省市地区建设“大数据+政务”。 在某市，华为云FusionInsight联结搭档建成“一云二网三平台”，在对立的政务数据逻辑模型的领导下，针对民生、产业、政府的“痛点”和“难点”，从构建城市数据资源库为开始，以大数据分析撑持政府智慧决策，以建设智慧利用为抓手，突破信息孤岛，实现信息资源替换共享，在 “数聚惠民”、“数聚兴业”、“数聚善政”三大方面，施展大数据的威力，撑持 “一号、一窗、一网” 政务服务，让简政放权、百姓办业务“最多跑一次”成为事实。 在金融畛域，国内50%的TOP20金融客户（含银行、证券、保险等）均已应用华为云FusionInsight构建其大数据平台。某行应用华为云FusionInsight构建大数据根底平台，撑持了银行企业级数据湖、数据仓库、团体信息库为外围的“一湖两库”建设，承载了总行及各支行业务零碎，撑持日常银行BI、AI、数据挖掘、数据分析等，实现了一份数据全局可用，罢黜数据搬迁，晋升协同效率10倍，存储周期晋升2倍，资源利用率最大可达90%，减速银行数字化转型过程。 在运营商畛域，国内三大运营商均应用华为云FusionInsight构建其大数据平台。广东挪动基于华为云FusionInsight，联结政企客户独特打造智慧电网、智慧交通、智慧港口、高清视频等系列标杆利用，买通数据全生命周期链路，实现对内业务撑持、对外利用赋能，全面撑持了各类政务、民生等大数据应用服务。 在交通畛域，深圳地铁在6、10号线采纳华为云FusionInsight构建大数据分析平台，打造当先的5G+大数据计划，并构建其数据资产核心和运行监控核心，承载地铁各业务零碎，撑持设施衰弱、能耗治理、客流统计、线路核心级监控、应急决策和图像型火灾剖析等线路级数据分析，数据分析效率从周级缩短至分钟级，实现高效经营，推动深圳步入更美妙的全联接数字化轨道交通新时代… 以及在环境保护方面，青海绿能数据有限公司基于华为云FusionInsight构建了国内首个能源大数据翻新平台，实现了布局辅助决策、用气象数据迷信领导发电等翻新业务，为上下游产业链企业提供25类47项数据服务，推动28座新能源场站实现了“无人值班、少人值守”，并无效撑持了青海“绿电15日”，以大数据为基石，建设绿色新青海，守护高原谐和生态。 同时，华为保持“本人的降落伞本人先跳”，华为团体IT通过FusionInsight构建OneData大数据集群，实现大数据平台在大规模场景下的开辟，OneData集群其规模已至1万+节点；同时，实现了对立的数据管理服务，在菩提海UniDB产品中，通过逻辑对立形式，把50+物理扩散的计算集群(Hadoop+MPP)，基于五对立（数据安全，元数据目录，数据集成，数据拜访，任务调度），整合成湖仓一体的架构，撑持上千个企业租户的PB级数据分析解决需要。一个基于FusionInsight MRS+DWS 的“+治理，+AI，+经营，+云”的交融数据底座(菩提海)曾经在华为团体IT宽泛应用，将来可期！ 以上只是“冰山的一角”，华为云FusionInsight一方面不断深入了解客户一直倒退的业务诉求，另一方面，继续技术创新并引领行业倒退，商业诉求+技术创新双轮驱动行业可继续、高质量倒退，“用数”助力客户商业胜利！下面的阐述曾经充分证明，华为云是“懂行”的大数据领导者，真正让客户用好数、管好数、释怀用！ 底子硬才是真的硬道理能够看到，无论是技术实力还是市场体现，华为云都做到了行业第一。 那么，在已有的问题背后，华为云是否“守得住”？这方面，从已有的动作看，差异化这个次要的特色之外，华为云维持本身位置还有三个方面的竞争劣势。 1. 长期的技术积淀 华为云 FusionInsight 大数据自 2009 年就开始投入钻研，最早在 2014 年推出商用产品，当初，MRS“大快融稳”的云原生数据湖、DWS企业级数据仓库以及一站式数据湖治理核心3项硬核能力都建设这样的长期积攒之上，不足技术积攒和了解的平台显然无奈实现这样的降级。 ...

November 12, 2020 · 1 min · jiezi

关于大数据:抖音Api用户搜索列表

抖音视频Api、抖音直播Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音用户搜寻列表Api：申请Apihttp://主机地址/douyin/search/users?token=xxx&keyword=热巴&cursor=0申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词cursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "challenge_list":null, "cursor":20, "extra":{ "fatal_item_ids":[ ], "logid":"202009142125500100290281622318FBCD", "now":1600089951000, "search_request_id":"" }, "has_more":1, "input_keyword":"热巴", "log_pb":{ "impr_id":"202009142125500100290281622318FBCD" }, "music_list":null, "myself_user_id":"0", "qc":"", "rid":"202009142125500100290281622318FBCD", "status_code":0, "type":1, "user_list":[ Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, { "challenges":null, "effects":null, "items":null, "mix_list":null, "musics":null, "position":null, "uniqid_position":null, "user_info":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"168x168/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_168x168.jpeg?from=2956013662" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"300x300/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_300x300.jpeg?from=2956013662" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"1080x1080/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_1080x1080.jpeg?from=2956013662" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"720x720/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_720x720.jpeg?from=2956013662" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"100x100/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df~c5_100x100.jpeg?from=2956013662" ], "width":720 }, "avatar_uri":"tos-cn-i-0813/7623b49a46dd44cba2d062c031d8b7df", "aweme_count":0, "bind_phone":"", "birthday":"2000-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":9, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p3-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p9-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":214, "fb_expire_time":0, "follow_status":0, "follower_count":6800, "follower_status":0, "followers_detail":null, "following_count":4, "gender":2, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":false, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"热巴", "original_musician":{ "digg_count":0, "music_count":0, "music_used_count":0 }, "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "room_id_str":"0", "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAA8vLHIRsiLyt-0m06Dvz0KuqkK3CfRSz2rytmFwrR39I", "secret":0, "share_info":{ "share_desc":"", "share_desc_info":"", "share_qrcode_url":{ "height":720, "uri":"8d740001ca53dfac4162", "url_list":[ "https://p6-dy-ipv6.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662", "https://p3-dy-ipv6.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662", "https://p9-dy.byteimg.com/obj/8d740001ca53dfac4162?from=2956013662" ], "width":720 }, "share_title":"", "share_title_myself":"", "share_title_other":"", "share_url":"", "share_weibo_desc":"" }, "share_qrcode_uri":"8d740001ca53dfac4162", "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"1037063419", "show_image_bubble":false, "signature":"爱本人♥", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":17330, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"98803352045", "unique_id":"daba1314", "unique_id_modify_time":1600089951, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"" } } ] }, "msg":"success"}

November 12, 2020 · 2 min · jiezi

关于大数据:抖音Api直播搜索列表

抖音视频Api、抖音直播Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音直播搜寻列表Api：申请Apihttp://主机地址/douyin/search/lives?token=xxx&keyword=热巴&cursor=20申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词cursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code": 200, "data": { "cursor": 12, "data": [ { "lives": { "anchors": null, "author": { "ad_cover_url": null, "avatar_larger": { "uri": "1080x1080/318820007c435e3fd4696", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "avatar_medium": { "uri": "720x720/318820007c435e3fd4696", "url_list": [ "https://p1-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "avatar_thumb": { "uri": "100x100/318820007c435e3fd4696", "url_list": [ "https://p9-dy.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038" ] }, "can_set_geofencing": null, "cha_list": null, "cover_url": null, "custom_verify": "", "enterprise_verify_reason": "", "followers_detail": null, "geofencing": null, "homepage_bottom_toast": null, "item_list": null, "need_points": null, "new_story_cover": null, "nickname": "南京迪丽热巴????", "platform_sync_info": null, "relative_users": null, "room_cover": { "uri": "webcast/6761373873079569163", "url_list": [ "http://p3-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image" ] }, "room_id": 6872334082282359552, "room_id_str": "6872334082282359552", "sec_uid": "MS4wLjABAAAAnGiirU7x9pMMMEdIqHn4ItxrggQ1G87HeWRX7GXWd_c", "short_id": "27648787", "type_label": null, "uid": "62256671560", "user_tags": null, "white_cover_url": null }, "aweme_id": "6872334082282359552", "aweme_type": 101, "cha_list": null, "challenge_position": null, "comment_list": null, "commerce_config_data": null, "cover_labels": null, "geofencing": null, "geofencing_regions": null, "group_id": "6872333965101960463", "hybrid_label": null, "image_infos": null, "interaction_stickers": null, "label_top_text": null, "long_video": null, "nickname_position": null, "origin_comment_ids": null, "position": null, "promotions": null, "rawdata": "{\"id\":6872334082282359552,\"id_str\":\"6872334082282359552\",\"status\":2,\"owner_user_id\":62256671560,\"title\":\"南京古力那扎????正在直\",\"user_count\":2,\"create_time\":1600089968,\"linkmic_layout\":1,\"cover\":{\"url_list\":[\"http://p3-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image\",\"http://p6-webcast-dycdn.byteimg.com/img/webcast/6761373873079569163~tplv-obj.image\"],\"uri\":\"webcast/6761373873079569163\",\"avg_color\":\"#DCF4FA\"},\"stream_url\":{\"id\":683840967322632337,\"id_str\":\"683840967322632337\",\"resolution_name\":{\"FULL_HD1\":\"蓝光\",\"HD1\":\"超清\",\"ORIGION\":\"原画\",\"SD1\":\"标清\",\"SD2\":\"高清\"},\"default_resolution\":\"ORIGION\",\"extra\":{\"height\":864,\"width\":480,\"fps\":15,\"max_bitrate\":900,\"min_bitrate\":300,\"default_bitrate\":800},\"rtmp_pull_url\":\"http://pull-flv-l11.douyincdn.com/stage/stream-683840967322632337.flv\",\"live_core_sdk_data\":{\"pull_data\":{\"stream_data\":\"{\\\"common\\\":{\\\"session_id\\\":\\\"000-202009142143070101450190863D1B7651\\\"},\\\"data\\\":{\\\"origin\\\":{\\\"main\\\":{\\\"flv\\\":\\\"http: //pull-flv-l11.douyincdn.com/stage/stream-683840967322632337.flv\\\",\\\"hls\\\":\\\"http: //pull-hls-l11.douyincdn.com/stage/stream-683840967322632337.m3u8\\\",\\\"cmaf\\\":\\\"\\\",\\\"dash\\\":\\\"\\\",\\\"sdk_params\\\":\\\"{ \\\\\\\"VCodec\\\\\\\": \\\\\\\"h265\\\\\\\", \\\\\\\"gop\\\\\\\": 4, \\\\\\\"resolution\\\\\\\": \\\\\\\"720x1280\\\\\\\", \\\\\\\"vbitrate\\\\\\\": 800000 }\\\"}}}}\",\"options\":{\"default_quality\":{\"name\":\"超清\",\"sdk_key\":\"origin\"}}}}},\"stats\":{\"total_user\":29},\"owner\":{\"id\":62256671560,\"short_id\":27648787,\"nickname\":\"南京迪丽热巴????\",\"gender\":2,\"signature\":\"想成为你的例外和偏爱\\n直播工夫 早晨9点半\\n微博：叫我么么\",\"level\":1,\"avatar_thumb\":{\"url_list\":[\"https://p9-dy.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p3-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p6-dy-ipv6.byteimg.com/aweme/100x100/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"100x100/318820007c435e3fd4696\"},\"avatar_medium\":{\"url_list\":[\"https://p1-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p29-dy.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p3-dy-ipv6.byteimg.com/aweme/720x720/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"720x720/318820007c435e3fd4696\"},\"avatar_large\":{\"url_list\":[\"https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p9-dy.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\",\"https://p1-dy-ipv6.byteimg.com/aweme/1080x1080/318820007c435e3fd4696.jpeg?from=4010531038\"],\"uri\":\"1080x1080/318820007c435e3fd4696\"},\"verified\":true,\"city\":\"南京\",\"status\":1,\"modify_time\":1600004002,\"share_qrcode_uri\":\"24a200425361734ca144\",\"badge_image_list\":[{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\",\"http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_honor_level_icon_new_22.png\",\"height\":16,\"width\":32,\"image_type\":1}],\"follow_info\":{\"following_count\":51,\"follower_count\":70186},\"pay_grade\":{\"total_diamond_count\":7324,\"level\":22,\"this_grade_min_diamond\":6600,\"this_grade_max_diamond\":8600,\"grade_describe\":\"间隔23级还差1276抖币\",\"new_im_icon_with_level\":{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\",\"http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_22.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_honor_level_icon_new_22.png\",\"height\":16,\"width\":32,\"image_type\":1},\"new_live_icon\":{\"url_list\":[\"http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_20_24.png~tplv-obj.image\",\"http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_20_24.png~tplv-obj.image\"],\"uri\":\"webcast/aweme_pay_grade_2x_20_24.png\",\"height\":12,\"width\":12,\"image_type\":1},\"score\":7324},\"fans_club\":{\"data\":{\"badge\":{\"icons\":{\"0\":{}}}}},\"user_attr\":{},\"own_room\":{\"room_ids\":[6872334082282359552],\"room_ids_str\":[\"6872334082282359552\"]},\"pay_score\":7324,\"ticket_count\":1131426,\"link_mic_stats\":1,\"display_id\":\"TBB20\",\"sec_uid\":\"MS4wLjABAAAAnGiirU7x9pMMMEdIqHn4ItxrggQ1G87HeWRX7GXWd_c\",\"authorization_info\":3,\"id_str\":\"62256671560\"},\"video_feed_tag\":\"直播中\",\"content_tag\":\"语音互动\"}", "search_extra": { "current_time": 1600090987 }, "text_extra": null, "uniqid_position": null, "video_labels": null, "video_text": null }, "type": 1 } ], "extra": { "fatal_item_ids": [ ], "logid": "202009142143070101450190863D1B7651", "now": 1600090987000, "search_request_id": "" }, "guide_search_words": null, "has_more": 0, "log_pb": { "impr_id": "202009142143070101450190863D1B7651" }, "status_code": 0 }, "msg": "success"}

November 12, 2020 · 1 min · jiezi

关于大数据:TikTok-Api搜索推荐视频用户标签等等

TikTok视频Api、TikTok爬虫、TikTok去水印、TikTok视频下载、TikTok视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口列表搜寻关键词搜寻用户关键词搜寻音乐关键词搜寻标签举荐相干用户随机举荐相干音乐随机举荐相干标签随机举荐用户用户视频列表视频视频详情（通过视频id查问）视频详情（通过链接查问）视频去水印解析风行视频列表标签标签列表标签趋势音乐音乐应用列表音乐趋势关键词搜寻用户接口示例申请Apihttp://主机地址/tiktok/search_for/user?keyword=funny&count=28&token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码keywordstring搜寻关键词countint返回数量返回示例{ "data": [ { "stats": { "diggCount": 606, "followerCount": 1500000, "followingCount": 6, "heart": 56800000, "heartCount": 56800000, "videoCount": 640 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e94c3a23773483dbc28d2abbc14a127a~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e94c3a23773483dbc28d2abbc14a127a~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e94c3a23773483dbc28d2abbc14a127a~c5_100x100.jpeg", "id": "6743938120749843462", "nickname": "funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAA7N4AJtt61_ZAflZ_KskEVShnOcDNKpv0jtkOWFSpH0GdhTcnDfH1NaRvyia4E_AJ", "secret": false, "signature": "????Memes\n????comedy\n????jokes\n????Goal: 2m followers\n????follow now to join our community", "uniqueId": "funny", "verified": false } }, { "stats": { "diggCount": 19, "followerCount": 118900, "followingCount": 0, "heart": 777400, "heartCount": 777400, "videoCount": 15 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e621cf9a6a0cf0cf30b5c76f7ccb2603~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e621cf9a6a0cf0cf30b5c76f7ccb2603~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/e621cf9a6a0cf0cf30b5c76f7ccb2603~c5_100x100.jpeg", "id": "6834476942265222150", "nickname": "funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAhjI6FCTS_3R0Ck__xYswcCLTscVJ7IXaPCnDVApK5OhSzFGcFrcdjZas5LEaxu7p", "secret": false, "signature": "Follow to see more", "uniqueId": "funtvprops", "verified": false } }, { "stats": { "diggCount": 2820, "followerCount": 134500, "followingCount": 5, "heart": 3200000, "heartCount": 3200000, "videoCount": 187 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1658472367074374~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=Ubvg2nR1IhUWMJIIaSaJb5dz5pQ%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1658472367074374~c5_720x720.jpeg?x-expires=1599883200&x-signature=Zq5eAEZ2jyqpK25%2BHjdDBYly%2BqA%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1658472367074374~c5_100x100.jpeg?x-expires=1599883200&x-signature=0q5MVsafqT7XLNhBwvwMMfxPDzk%3D", "id": "6615744317989273606", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAkkS56Onf5FuuGPThOuNfocu4jIUY6_5N0zIWLDE-IxAn-79Zl6xtcehjdnZOeSce", "secret": false, "signature": "not the creator I put my own touch to a vid in post it thanks for stopping by????", "uniqueId": "funnymemos", "verified": false } }, { "stats": { "diggCount": 330, "followerCount": 96900, "followingCount": 46, "heart": 561900, "heartCount": 561900, "videoCount": 5 }, "user": { "avatarLarger": "https://p16-sign-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/1663315840873473.jpeg?x-expires=1599883200&x-signature=I%2Bez0Hf04kM2P3m0K%2FZ61jwGRPw%3D", "avatarMedium": "https://p16-sign-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/1663315840873473.jpeg?x-expires=1599883200&x-signature=p5ZZceVLNhRbtWwdPHYHY2VUHsE%3D", "avatarThumb": "https://p16-sign-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/1663315840873473.jpeg?x-expires=1599883200&x-signature=Ns9Y5hC2ndGUc3Wl46AEIOsjXu8%3D", "id": "6812907513626018817", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAPIJGQ_l_8-VhCnW99CVptpLcwdYd3jBg7XFsQ7LH7pbF4RQ_xxcReGyqrdBRNXoq", "secret": false, "signature": "Fb : Doãn Hải Nam", "uniqueId": "funny7968", "verified": false } }, { "stats": { "diggCount": 4105, "followerCount": 509700, "followingCount": 157, "heart": 6300000, "heartCount": 6300000, "videoCount": 146 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1621949775425702~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=%2BGdhjjiNZTQ3p9E%2BBPnBZEh3f4Q%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1621949775425702~c5_720x720.jpeg?x-expires=1599883200&x-signature=z%2Fs0L5e8vSFdhEm9yE3q3%2BUGBcQ%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1621949775425702~c5_100x100.jpeg?x-expires=1599883200&x-signature=TpXW3xcNJzks1pNCGhxFQU1niZg%3D", "id": "6515079495379063808", "nickname": "angelinaspicer", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAA_ecQ3G8GO6e_3llvdKxbZnEIbMbs4Q3txk9jDDKhIGViVRs8PZwD1IF7nyX76wOh", "secret": false, "signature": "I’m a stand up comedian & mommy!!\nDM’ing new followers ⬇️", "uniqueId": "funnyangelinaspicer", "verified": true } }, { "stats": { "diggCount": 827, "followerCount": 55300, "followingCount": 5604, "heart": 1100000, "heartCount": 1100000, "videoCount": 14 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1656592942637062~c5_1080x1080.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1656592942637062~c5_720x720.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1656592942637062~c5_100x100.jpeg", "id": "6785403106495988742", "nickname": "FUNNY", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAByVYdJPv2B74aq8woLF3dCyHW0vomqNiBsJH6VsQ4iA2DV7gIH_q-QFQzvAfyfDq", "secret": false, "signature": "???? MAKE MONEY ONLINE ???? \n????100% REAL ????\n????????????????????????????????????????????????", "uniqueId": "funny__content__", "verified": false } }, { "stats": { "diggCount": 10200, "followerCount": 53400, "followingCount": 86, "heart": 1500000, "heartCount": 1500000, "videoCount": 114 }, "user": { "avatarLarger": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1660814520186886~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=FbhoDA4gfUGMvCmiNxOhxx2uBnQ%3D", "avatarMedium": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1660814520186886~c5_720x720.jpeg?x-expires=1599883200&x-signature=cfXlaONyNHgJbjKe5aX5Ik6l0iw%3D", "avatarThumb": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1660814520186886~c5_100x100.jpeg?x-expires=1599883200&x-signature=lTOdwsyRIRnn451CFIzB2h6L0kA%3D", "id": "6802694192171959302", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAvbPt98aVlnZLfEybVV-ZHqSFInJlS43yg2UEJp8Cbn7ChmwdNriJsHvPi1cI4ZPz", "secret": false, "signature": "GET A FREE STOCK SHARE WORTH UP TO 100 WHEN YOU SIGN UP THROUGH THIS LINK⬇️⬇️⬇️", "uniqueId": "funnyclips321", "verified": false } }, { "stats": { "diggCount": 1753, "followerCount": 73600, "followingCount": 6, "heart": 1800000, "heartCount": 1800000, "videoCount": 91 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/8d14766355f8ef6eeaf9f36c12fa211c.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/8d14766355f8ef6eeaf9f36c12fa211c.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/8d14766355f8ef6eeaf9f36c12fa211c.jpeg", "id": "62165839299", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAF_mWdcUfjJEk7s24XcjrkbrvWq1ggE2rz0nHa-BYRts", "secret": false, "signature": "Fl mình để xem những video thú vị????????\n\nhttps://m.facebook.com/Funnyy-10222195828", "uniqueId": "funnyy0107", "verified": false } }, { "stats": { "diggCount": 1300, "followerCount": 50800, "followingCount": 2745, "heart": 347, "heartCount": 347, "videoCount": 5 }, "user": { "avatarLarger": "https://p16-sign-sg.tiktokcdn.com/tos-maliva-avt-0068/5be3214983d59798880d645bd6692d3d~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=iLCg2FvtW8kbrsAGG7JwrLHrynY%3D", "avatarMedium": "https://p16-sign-sg.tiktokcdn.com/tos-maliva-avt-0068/5be3214983d59798880d645bd6692d3d~c5_720x720.jpeg?x-expires=1599883200&x-signature=OLA%2B1W%2FpF2moICOVKgUF5PS94Z8%3D", "avatarThumb": "https://p16-sign-sg.tiktokcdn.com/tos-maliva-avt-0068/5be3214983d59798880d645bd6692d3d~c5_100x100.jpeg?x-expires=1599883200&x-signature=hAqalluFd%2FTPrGLZfDeNm8hdU6g%3D", "id": "6794301317324293126", "nickname": "Funny", "openFavorite": true, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAASzlWRzyCatK4CH0s4qZwwG5yykf2OsVkNAW02C4xoLU3Dt5LX5AYH0zHxeChzVzJ", "secret": false, "signature": "", "uniqueId": "funnyyyyyyyyv", "verified": false } }, { "stats": { "diggCount": 347, "followerCount": 30500, "followingCount": 474, "heart": 187800, "heartCount": 187800, "videoCount": 52 }, "user": { "avatarLarger": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1662861210896389~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=DBvA8gYFKAX7%2Fwz7bEWAQeVaeUA%3D", "avatarMedium": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1662861210896389~c5_720x720.jpeg?x-expires=1599883200&x-signature=zo4Vm8CuL24n7JXBWDHvfqeof%2F8%3D", "avatarThumb": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/1662861210896389~c5_100x100.jpeg?x-expires=1599883200&x-signature=D2gGQe6uw%2B2I7uRmsTGoEhyH%2Fio%3D", "id": "6810001119625544709", "nickname": "funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAR6Kyf21i0fHk3jwcJd_S_J1Rq1KcTAcWUPua9sfcVtYzCXwgOr4HBvNu0oh0UsZ9", "secret": false, "signature": "diversão e risadas", "uniqueId": "funnyoficial", "verified": false } }, { "stats": { "diggCount": 983, "followerCount": 40700, "followingCount": 29, "heart": 162300, "heartCount": 162300, "videoCount": 58 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/a2fb39406694dc939c53f0798d1f3d64~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=HOqLvTGWfDSTzscUN5GLnpVrrbE%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/a2fb39406694dc939c53f0798d1f3d64~c5_720x720.jpeg?x-expires=1599883200&x-signature=LOqp0xeBnymTuPE%2FwAMGlxZzF9U%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/a2fb39406694dc939c53f0798d1f3d64~c5_100x100.jpeg?x-expires=1599883200&x-signature=k1sG6wn3Xsyle%2BIOeBgqkX8d7HE%3D", "id": "6836517974897263622", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAFlsWzi9otSuVSuxxnm3BqeHacYONfz3smteHphPY4LI68QKgxeTsBNpiKy3frw_R", "secret": false, "signature": "Thx so much we started off so little and then we’re\nHuge thx so much❤️❤️❤️", "uniqueId": "toxic1695", "verified": false } }, { "stats": { "diggCount": 0, "followerCount": 390600, "followingCount": 0, "heart": 6800000, "heartCount": 6800000, "videoCount": 130 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/1616924928098305.PNG.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/1616924928098305.PNG.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/1616924928098305.PNG.jpeg", "id": "6618085442174582786", "nickname": "Interesting", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAWMBxS9Ja07qvHr1dGnQsSyEsmADwJvTvDmAF7ZS1nQo_qyoFFa3pSHu2daLPF84e", "secret": false, "signature": "I'm not kidding\nJust can't help laughing", "uniqueId": "funny_goe", "verified": true } }, { "stats": { "diggCount": 2237, "followerCount": 34500, "followingCount": 0, "heart": 378600, "heartCount": 378600, "videoCount": 184 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/182db1a4370567dcf7026f815dc4dddb~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/182db1a4370567dcf7026f815dc4dddb~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/182db1a4370567dcf7026f815dc4dddb~c5_100x100.jpeg", "id": "6829791643899184133", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAhC3iVwLwJYWKZqWwGy9Bz2IMv0nRA0nGSxLmlBApXSAuRgOZeQxztkm3mJXxc1d9", "secret": false, "signature": "???? Funny Cool Content Daily Memes\n???? TikTok Interesting Comedy\nFollow @imkristo", "uniqueId": "comedyhumor", "verified": false } }, { "stats": { "diggCount": 104, "followerCount": 33900, "followingCount": 12, "heart": 193500, "heartCount": 193500, "videoCount": 6 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/1598158638272513.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/1598158638272513.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/1598158638272513.jpeg", "id": "80998599632", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAm-rsQIU7G0jBgLez7YXeKmJIfPoWNS-i84c8-EPtflc", "secret": false, "signature": "Thx to seeing ????", "uniqueId": "160912469", "verified": false } }, { "stats": { "diggCount": 280, "followerCount": 30400, "followingCount": 44, "heart": 10900, "heartCount": 10900, "videoCount": 0 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1665779400842245~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=JcGJTRK7lHYcVm92Iz4UvdOIubk%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1665779400842245~c5_720x720.jpeg?x-expires=1599883200&x-signature=miAiB%2BmBZqEN4FCi4GSQM5FKpf4%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1665779400842245~c5_100x100.jpeg?x-expires=1599883200&x-signature=XARoJlLfkSDktiAKN0XqhjgdheI%3D", "id": "13447615", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAu_s6uXUz5Cy3T1yYY_e2cKT1a5rL3kOQGwold00L_go", "secret": false, "signature": "Best comedy ????????\nJust for laughs & giggles ????", "uniqueId": "tiktokrepiay", "verified": false } }, { "stats": { "diggCount": 120, "followerCount": 1500000, "followingCount": 8, "heart": 16800000, "heartCount": 16800000, "videoCount": 84 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1662097587106821~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1662097587106821~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1662097587106821~c5_100x100.jpeg", "id": "6800469622652470273", "nickname": "FunnyAsianDude", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAABIob7raHjZf44UM8zPO7pSBqrQuaKcjjh-mhVWkh5L1Lhjp37wNS_rgI_Bu5YZqF", "secret": false, "signature": "Subscribe to my YouTube channel for full clips. Full special on Amazon Prime Vid", "uniqueId": "funnyasiandude", "verified": true } }, { "stats": { "diggCount": 132, "followerCount": 15700, "followingCount": 44, "heart": 336600, "heartCount": 336600, "videoCount": 6 }, "user": { "avatarLarger": "https://p53-sg.tiktokcdn.com/aweme/1080x1080/tos-alisg-avt-0068/fd34950146a9f66b2a1c9267b106c62a.jpeg", "avatarMedium": "https://p53-sg.tiktokcdn.com/aweme/720x720/tos-alisg-avt-0068/fd34950146a9f66b2a1c9267b106c62a.jpeg", "avatarThumb": "https://p53-sg.tiktokcdn.com/aweme/100x100/tos-alisg-avt-0068/fd34950146a9f66b2a1c9267b106c62a.jpeg", "id": "6508134991272460290", "nickname": "funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAUkWuxsOfoI7I1qtVyfSFH3YVnoB3cJWXTT9QxWCRkrDX8CjA_g4ltC-ITWn931mm", "secret": false, "signature": "ig follow @bossgoyang", "uniqueId": "taik.kucing", "verified": false } }, { "stats": { "diggCount": 160, "followerCount": 24100, "followingCount": 1, "heart": 432900, "heartCount": 432900, "videoCount": 9 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/995792757c26b00ab7a3abad63ab3cc8~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/995792757c26b00ab7a3abad63ab3cc8~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/995792757c26b00ab7a3abad63ab3cc8~c5_100x100.jpeg", "id": "6841347424314524677", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAaydhEmqCuXIuvCK6VAAKtcNEDmCZE6dw-pEPkJDYmXTKro2SZoKtsYSUjVIFee7Y", "secret": false, "signature": "I play games like Minecraft and CS:GO\nI love my 23k followers", "uniqueId": "gre2.mc", "verified": false } }, { "stats": { "diggCount": 1891, "followerCount": 26300, "followingCount": 445, "heart": 172100, "heartCount": 172100, "videoCount": 94 }, "user": { "avatarLarger": "https://p58-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/688cd1662197bab8931ba4531d0f0c15.jpeg", "avatarMedium": "https://p58-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/688cd1662197bab8931ba4531d0f0c15.jpeg", "avatarThumb": "https://p58-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/688cd1662197bab8931ba4531d0f0c15.jpeg", "id": "6689279114996401158", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAoGue3cCjpud6yZ20ECt0Ck_fBRNMvXVa1ghx_GVo_wNaUTcZygrCuYKyf8lENTe5", "secret": false, "signature": " \n-20-30 \n20√????????\n25-????????\n30-????????", "uniqueId": "funny__brawl_stars", "verified": false } }, { "stats": { "diggCount": 49400, "followerCount": 15300, "followingCount": 214, "heart": 168100, "heartCount": 168100, "videoCount": 2739 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1659363268550661~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=PsWLo6WZchSt0ZUe5TSovsFs8ME%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1659363268550661~c5_720x720.jpeg?x-expires=1599883200&x-signature=fjY0Z0glIntr0OJewiDomXbmuOU%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/musically-maliva-obj/1659363268550661~c5_100x100.jpeg?x-expires=1599883200&x-signature=F7AkbN8h1blGulRSM7%2FdJW0c9tc%3D", "id": "6699581939072025606", "nickname": "funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAksLnWMoeVGhscCQYlqVTLB0UNR8ogWZM_gAGsSYBnt4Wmye0OCZoomkXG0SnykIM", "secret": false, "signature": "feel free to duet me. \n ???? no bullying or hate ????", "uniqueId": "funnymore1414", "verified": false } }, { "stats": { "diggCount": 1219, "followerCount": 21600, "followingCount": 16, "heart": 553200, "heartCount": 553200, "videoCount": 93 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/c673a4b386d0056cf6fe59817fe99f82~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/c673a4b386d0056cf6fe59817fe99f82~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/c673a4b386d0056cf6fe59817fe99f82~c5_100x100.jpeg", "id": "6783085537631175685", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAkYwfTufIAOqBLl5lhJj55y2KCR4L7kzzNqALJY8Xwvdg1y33B6MwL0_nJyBSXQgz", "secret": false, "signature": "Thanks so much for 20k can we git 30k please", "uniqueId": "funnyboyzs1", "verified": false } }, { "stats": { "diggCount": 19000, "followerCount": 14600, "followingCount": 144, "heart": 444800, "heartCount": 444800, "videoCount": 119 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/b5f37b9e7fce94e0f63a27f02da92df8~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/b5f37b9e7fce94e0f63a27f02da92df8~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/b5f37b9e7fce94e0f63a27f02da92df8~c5_100x100.jpeg", "id": "6828064022639592453", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAwHJb--N2Q7XNA68hES8QAfX9TEyi16IqMK2KPCPjcTsWSPX-V7CIzmw39V_bUr8a", "secret": false, "signature": "Funny haha", "uniqueId": "stinky_stonky1", "verified": false } }, { "stats": { "diggCount": 9074, "followerCount": 18300, "followingCount": 122, "heart": 306900, "heartCount": 306900, "videoCount": 17 }, "user": { "avatarLarger": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1654685420329989~c5_1080x1080.jpeg", "avatarMedium": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1654685420329989~c5_720x720.jpeg", "avatarThumb": "https://p16-amd-va.tiktokcdn.com/img/musically-maliva-obj/1654685420329989~c5_100x100.jpeg", "id": "6566202205963190277", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAoiyfkDeVIqMvVL8NhUVEqMW7enfpDyuCgEyJ3RaK-vzeQffdItqeRSjTVEoMEHyV", "secret": false, "signature": "I’m actually shy believe it or not", "uniqueId": "ilikesleepingalot", "verified": false } }, { "stats": { "diggCount": 72800, "followerCount": 15500, "followingCount": 55, "heart": 5650, "heartCount": 5650, "videoCount": 73 }, "user": { "avatarLarger": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/b754388e1ac51aa21b1bbc388934495c~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=AHU%2FKSa8%2B4u8bfHMRkzHadqgswY%3D", "avatarMedium": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/b754388e1ac51aa21b1bbc388934495c~c5_720x720.jpeg?x-expires=1599883200&x-signature=KCwBrYBBjGin%2FrtWO%2FtmA8VGn74%3D", "avatarThumb": "https://p16-sign-sg.tiktokcdn.com/musically-maliva-obj/b754388e1ac51aa21b1bbc388934495c~c5_100x100.jpeg?x-expires=1599883200&x-signature=%2Fj45mbn114ERYwF3dUqB0VQC0Tg%3D", "id": "6674991953312482309", "nickname": "Funny ", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAnFOOynh31LPnlolCjdNZPR8MK5VUl5qxQhBOrEiiULQtBiJJGvI9Vo9Dn2KjraXm", "secret": false, "signature": "Facebook ID Dliawar Msaood", "uniqueId": "dliawar7", "verified": false } }, { "stats": { "diggCount": 38700, "followerCount": 13000, "followingCount": 4594, "heart": 104500, "heartCount": 104500, "videoCount": 205 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1666336625171462~c5_1080x1080.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1666336625171462~c5_720x720.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1666336625171462~c5_100x100.jpeg", "id": "6783393102873281542", "nickname": "Funny", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAOZXpOGEjA1lj1X3aBHkquOJNlZYAANLxvD9UyPFfVbsoYICsxfx5TbHEwPsrMqRd", "secret": false, "signature": "# #mutualsubscription #memes", "uniqueId": "mister_funny", "verified": false } }, { "stats": { "diggCount": 1066, "followerCount": 333600, "followingCount": 2, "heart": 20700, "heartCount": 20700, "videoCount": 1 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1663259054653446~c5_1080x1080.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1663259054653446~c5_720x720.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/img/musically-maliva-obj/1663259054653446~c5_100x100.jpeg", "id": "6700548827835024389", "nickname": "Funnyyyyy", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAAKZDwZZ65IhUrsXJtzStP50dTHxUGO1U1ZJiExYXZOMVJcGIr-I4fXq2QqhS2clAj", "secret": false, "signature": "", "uniqueId": "funnyvideostowatcx", "verified": false } }, { "stats": { "diggCount": 38, "followerCount": 601100, "followingCount": 15, "heart": 5400000, "heartCount": 5400000, "videoCount": 132 }, "user": { "avatarLarger": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/1674294095069189~c5_1080x1080.jpeg?x-expires=1599883200&x-signature=xO7k3xxBYWkQuapHirzxGTabPOs%3D", "avatarMedium": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/1674294095069189~c5_720x720.jpeg?x-expires=1599883200&x-signature=1wfd1XdSrRcvhZxIy%2BfTKSljUVs%3D", "avatarThumb": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/1674294095069189~c5_100x100.jpeg?x-expires=1599883200&x-signature=LA91xZ1zvMzXhvjsb3EiWNu1LwA%3D", "id": "6857334383705523205", "nickname": "Funny&Creative", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAACXrt50HJbmFAaBz4G2rk8RoDq3us0Ki7ABV0_DDItSTQELvT-GqUWuOprSZjVLXL", "secret": false, "signature": "Please follow me,Make you laugh every day. ????????????\nEmail:licheng518@hotmail.com", "uniqueId": "kongde66", "verified": false } }, { "stats": { "diggCount": 743, "followerCount": 432200, "followingCount": 0, "heart": 6800000, "heartCount": 6800000, "videoCount": 549 }, "user": { "avatarLarger": "https://p16-sg.tiktokcdn.com/aweme/1080x1080/tiktok-obj/34e8ae5f826d16422fb5abccd0394327.jpeg", "avatarMedium": "https://p16-sg.tiktokcdn.com/aweme/720x720/tiktok-obj/34e8ae5f826d16422fb5abccd0394327.jpeg", "avatarThumb": "https://p16-sg.tiktokcdn.com/aweme/100x100/tiktok-obj/34e8ae5f826d16422fb5abccd0394327.jpeg", "id": "6613740024428494854", "nickname": "funnnyanimated", "openFavorite": false, "privateAccount": false, "relation": 0, "secUid": "MS4wLjABAAAABqOYzW8Cy_W9NagVq8gAb9X5Yw7YAbLWTnsJ1PN9NopmQJ_2hHMgE9ZOE-itHmyV", "secret": false, "signature": "Contact me on Instagram", "uniqueId": "funny.animated", "verified": false } } ], "code": 200, "msg": "胜利"}

November 11, 2020 · 7 min · jiezi

关于大数据:实时数据融合之法稳定高容错

陈雷 | DataPipeline 合伙人 & CPO曾任 IBM 大中华区认知物联网实验室服务部首席数据科学家、资深参谋经理。十年治理教训，十五年数据迷信畛域与金融畛域教训。综合交通大数据利用技术国家工程实验室产业翻新部主任，西安交通大学软件学院大数据智能翻新核心主任，中国电子学会区块链专委会委员。 上周咱们公布了“实时数据交融之道，博观约取，价值驱动”，文章提到实时数据既要全面笼罩能被利用的各类数据，也要基于价值分清先后顺序；既要高效开释数据价值，也要选好抓手、切入点。而触客业务因为间接与支出相干，无疑成为实时数据最好的切入点。也正因为其重要性和敏感性，所以大家更为关注实时数据交融过程中的稳固高容错。 不论是绝地求生还是企业级零碎，稳固输入都是最重要的。 上下游不稳固时，你得稳固实时数据在获取与加载过程中，上下游节点个别都是注册机制而不是纳管机制，零碎很难实时感知到上下游节点的理论状态和产生的问题，在理论企业环境中，实时数据交融的上下游节点往往在业务连续性和服务级别上高于实时数据交融零碎，因而，实时数据的解决须要遵循上下游节点的管理机制，例如认证形式、平安加密形式、连贯时长、最大连接数，甚至于日志模式也须要你来适应，更不用说上下游节点可不止一种类型，在充沛调研筹备和依赖管理机制之外，须要实时数据交融具备足够的策略配置与容错机制来应答上下游零碎不稳固带来的不确定性，从而保障本身的稳定性。 构造不稳固时，你得稳固上下游节点咱们稳住之后，你就须要思考节点外部对象不稳固的问题了，也就是所谓的DDL问题，起因同上，可能在一些信息化程度较高的企业中，任何的数据结构调整须要首先在数据管控平台进行影响剖析，告诉所有上游零碎联调测试后对立上线切换，可这毕竟是他人家的孩子，到了本人家，还有各种各样的起因会呈现。上游系统结构变动是在你意想不到的时候呈现的，而上游零碎嗷嗷待哺，定责分锅那是前面的事，先得保障业务不能停，因而就要求实时数据处理须要可能提供欠缺的构造变动应答策略，而针对不同的数据节点类型和增量获取机制，构造变动的感知形式也不尽相同，有的简略高效，有的老本极高，这又须要实时数据交融可能依照不同的场景进行取舍与配置，从而保障本身的稳定性。 流量不稳固时，你得稳固一开始解决实时数据时，咱们往往把实时数据与交易数据，行为数据等时序数据挂钩，而在理论企业环境中，往往会呈现局部零碎某些状况下大面积更新操作，上游增量会忽然增大，平时他宁静得像山间的小溪，一转脸它变成了壶口的黄河，所以实时数据的流量往往和上游利用零碎、数据模型、数据管理机制的设计无关，而不能仅仅基于交易量进行评估，在准确的容量评估与资源筹备之外，还须要思考资源的利用率和老本问题，因而就要求实时数据交融领有弱小的反压解决机制和灵便的读取、写入限度配置，能够通过管制读取速率、并行度、批次大小的形式，实现增量数据反压的解决，从而保障本身的稳定性。 环境不稳固时，你得稳固一般来说，企业级环境中网络、存储、计算设施的稳定性还是能够保障的，但我敢保障，就像每个谢顶的程序员都有那么几个加班的夜晚一样，每个运维工程师都能讲几个零碎莫名其妙出问题又莫名其妙就复原了的灵异故事，因而就要求实时数据处理可能提供预设策略在无打算的网络不可用、呈现未知异样等状况下进行从新连贯，重置线程乃至重启工作等自动化操作，从而保障本身的稳定性。 ——好稳呀，不过领导，这么多配置，这得搞多长时间呀？——工夫？工夫是没有的。咱们什么时候有过工夫？所以你再往下看。 下一期咱们将从配置便捷、部署便捷、分层治理、按需服务四个方面详谈“实时数据交融之法，便捷可治理”，请大家继续关注！

November 11, 2020 · 1 min · jiezi

关于大数据:数据系统架构4指标定义系统

4.指标定义零碎序在领有了各种数据之后，咱们打造了对应的数据仓库，接下来咱们就要统计各种各样的数据指标。这些数据指标用来提供给产品、经营相干人员进行相干业务的剖析，成为疾速的调整业务策略、制订决策计划的数据根据。然而因为产品、经营人员的背景认知不同，对一个雷同指标的了解定义可能不同，就会造成数据产品在最终出现上产生各种各样的歧义。那目前咱们面临的问题如下 同名指标在不同看板下数据不统一问，常常须要重复确认与排查（指标同名不同义）现有的各种需要管理软件并不适宜数据指标常识的记录与积淀积攒（无奈按主题积淀指标）一个需要一个规范，各种各样的指标定义，人员到职之后，新同学不能疾速的了解之前的口径，又须要依照新同学的了解从新开发定义对应的数据报表（数据了解应用老本高） 为了解决上述的问题，咱们也做过一些尝试，比方：做了一套指标形容的零碎，用修饰词+原子指标+工夫周期的形式定义指标，这个指标绑定在了后果数据上，尽管在肯定水平上解决了问题，然而没方法保证数据统计程序的统一，数据起源统一，还是无奈彻底解决 指标同名不同义的问题。 所以须要从指标口径的源头开始去梳理和定义指标，打造一套指标定义零碎，这个零碎就是数据开发、产品、经营、数据产品、业务RD各方用户对指标定义形容，造成指标共识的中央。在该零碎下依照主题划分，在提出数据需要之前，就应该依据日志、表、数仓等相干数据配置与造成对应的数据口径，如果是已有口径，满足需要也无需再次定义与数据开发，让同一个业务线的人员造成对立的规范。后续各种指标开发都根据零碎当中定义的规定，对接指标实时、离线模式化统计模块，依据配置间接统计出各个指标数据。 通过该零碎从本源上解决上述，指标同名不同义、指标形容、指标积淀等问题。 零碎设计 1.数据对象形象数据对象形象包含前端日志、后端日志、源表、数仓表，形象的对象须要是可解析结构化的数据。 日志形象：日志因为有前端日志、后端日志，前端日志在人造上采纳了结构化的日志所以无需进行提前荡涤；后端日志依据采纳的数据格式，须要提前通过ETL荡涤成结构化的数据。结构化的日志最终也是保留在hive对应的表当中，表构造就是一个表形象对象，能够间接用来表述各个指标的统计规定；源表、数仓表形象：对应的表构造就是形象的对象，以此形容指标信息；2.指标规定形容主题域划分：依据不同的主题划分指标的定义，比方A业务线在提数据需要之前或者须要理解统计指标定义的时候，能够通过零碎疾速查找到对应主题域下的各类指标信息，未定义的指标能够通过配置实现新指标的创立与规定形容；逻辑表白：通过配置化，最大化反对各种状况下指标逻辑的表白，比方过滤、join、聚合、明细等等，最终造成一个可解析的指标配置，后续各种统计零碎能够对接配置信息，实现自动化指标的统计与hive数仓表的生成。记录指标规定的各种信息与版本，清晰明了指标口径的变更记录等相干信息。（下图为SQL图形化编辑器，简略示意逻辑表达方式） 零碎利用1、hive数仓表通过对应离线数据统计零碎，配置输出指标配置信息、输入的目的地。由各个指标组合dm层相干的数据表、明细表等。 2、实时、离线指标数据统计通过对接指标零碎，由统计零碎解析指标配置，自动化计算与输入后果，达到实时、离线指标统计的自动化。 总结咱们有了这样的一个零碎之后，后续的数仓表、数据统计等相干性能都能够与之对接，造成统一口径标准化的数据。整体大数据相干的零碎要向着系统化、工具化、配置化、SQL化的方向倒退，尽可能的缩小人工SQL统计与开发。不光产品、经营通过图形化的SQL实现数据分析等工作，数据开发人员也能够通过图形化SQL配置生成对应的统计逻辑。再通过各个系统之间数据的买通，咱们就有着清晰的数据脉络与数据流向。 指标来自于业务，积淀于业务，利用于业务简单的问题在数据流程越靠前的地位上解决，之后设计的各种零碎就会越简略，事倍功半

November 11, 2020 · 1 min · jiezi

关于大数据:Pulsar-Summit-Asia-2020-中文专场议题出炉

对于 Apache Pulsar Apache Pulsar 是 Apache 软件基金会顶级我的项目，是下一代云原生分布式音讯流平台，集音讯、存储、轻量化函数式计算为一体，采纳计算与存储拆散架构设计，反对多租户、长久化存储、多机房跨区域数据复制，具备强一致性、高吞吐、低延时及高可扩展性等流数据存储个性。 对于 Pulsar Summit Pulsar Summit 是 StreamNative 组织的 Apache Pulsar 社区年度盛会，它将散布在世界各地的 Apache Pulsar 我的项目 Contributor、Commiter 和各企业 CTO/ CIO、开发者、架构师、数据科学家，以及音讯和流计算社区的精英招集在一起。于此盛会，大家分享实践经验、交换想法、探讨对于 Pulsar 我的项目和社区的常识，切磋互动。Pulsar Summit Asia 旨在汇集亚洲地区 Pulsar 开发者和贡献者，促成 Apache Pulsar 在亚洲地区的倒退。Pulsar Summit Asia 2020 将于 11 月 28-29 日以线上直播模式发展。 从 9 月初启动演讲征集到 10 月中旬征集截止，近 1 个半月的工夫，咱们收到了泛滥 Pulsar 用户、贡献者、开发者和技术爱好者提交的高质量演讲议题，涵盖 Pulsar 场景案例、 操作运维、技术探索、周边生态 四个方面。除了亚洲地区，欧美地区 Pulsar 开发者也踊跃提交议题，心愿借此机会通过线上形式与亚洲地区 Pulsar 开发者独特交换。 值得关注的是，在本次演讲征集过程中，亚洲地区的开发者更加踊跃、体现不凡，他们来自中国大陆、日本、印度等地，符合了 Pulsar Summit Asia 2020 聚焦亚洲地区的初心，为亚洲 Pulsar 开发者点赞！ ...

November 10, 2020 · 1 min · jiezi

关于大数据:抖音Api视频评论列表

抖音视频Api、抖音直播Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博抖音视频评论列表Api：申请Apihttp://主机地址/douyin/video/comments?token=xxx&aweme_id=6849103450475711752&cursor=0申请形式GET参数字段类型阐明tokenstring接口受权码aweme_idint视频的aweme_idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例{ "code":200, "data":{ "comments":[ { "aweme_id":"6870813760379030796", "cid":"6870867767437230091", "create_time":1599748572, "digg_count":82810, "is_author_digged":false, "label_list":null, "reply_comment":null, "reply_comment_total":4489, "reply_id":"0", "reply_to_reply_id":"0", "status":1, "stick_position":0, "text":"还有谁跟我一样傻傻的看完了[呲牙]", "text_extra":[ ], "user":{ "accept_private_policy":false, "account_region":"", "ad_cover_url":null, "apple_account":0, "authority_status":0, "avatar_168x168":{ "height":720, "uri":"168x168/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_168x168.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_168x168.webp?from=2956013662", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_168x168.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_168x168.jpeg?from=2956013662" ], "width":720 }, "avatar_300x300":{ "height":720, "uri":"300x300/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_300x300.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_300x300.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_300x300.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_300x300.jpeg?from=2956013662" ], "width":720 }, "avatar_larger":{ "height":720, "uri":"1080x1080/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_1080x1080.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_1080x1080.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_1080x1080.webp?from=2956013662", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_1080x1080.jpeg?from=2956013662" ], "width":720 }, "avatar_medium":{ "height":720, "uri":"720x720/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_720x720.webp?from=2956013662", "https://p1-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_720x720.webp?from=2956013662", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_720x720.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_720x720.jpeg?from=2956013662" ], "width":720 }, "avatar_thumb":{ "height":720, "uri":"100x100/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "url_list":[ "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_100x100.webp?from=2956013662", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_100x100.webp?from=2956013662", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_100x100.webp?from=2956013662", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad~c5_100x100.jpeg?from=2956013662" ], "width":720 }, "avatar_uri":"tos-cn-i-0813/347e5ae1a1d24a14a238ed073d6d55ad", "aweme_count":0, "bind_phone":"", "birthday":"1982-01-01", "can_set_geofencing":null, "cha_list":null, "comment_filter_status":0, "comment_setting":0, "commerce_user_level":0, "constellation":10, "cover_url":[ { "height":720, "uri":"c8510002be9a3a61aad2", "url_list":[ "https://p26-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p29-dy.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662", "https://p6-dy-ipv6.byteimg.com/obj/c8510002be9a3a61aad2?from=2956013662" ], "width":720 } ], "create_time":0, "custom_verify":"", "cv_level":"", "download_prompt_ts":0, "download_setting":-1, "duet_setting":0, "enable_nearby_visible":true, "enterprise_verify_reason":"", "favoriting_count":0, "fb_expire_time":0, "follow_status":0, "follower_count":0, "follower_status":0, "followers_detail":null, "following_count":0, "gender":1, "geofencing":[ ], "google_account":"", "has_email":false, "has_facebook_token":false, "has_insights":false, "has_orders":false, "has_twitter_token":false, "has_unread_story":false, "has_youtube_token":false, "hide_location":false, "hide_search":false, "homepage_bottom_toast":null, "ins_id":"", "is_ad_fake":false, "is_binded_weibo":false, "is_block":false, "is_discipline_member":false, "is_gov_media_vip":false, "is_phone_binded":false, "is_star":false, "is_verified":true, "item_list":null, "language":"zh-Hans", "live_agreement":0, "live_agreement_time":0, "live_commerce":false, "live_verify":0, "location":"", "need_points":null, "need_recommend":0, "neiguang_shield":0, "new_story_cover":null, "nickname":"樊长林", "platform_sync_info":null, "prevent_download":false, "react_setting":0, "reflow_page_gid":0, "reflow_page_uid":0, "region":"CN", "relative_users":null, "room_id":0, "school_name":"", "school_poi_id":"", "school_type":0, "sec_uid":"MS4wLjABAAAAfq7S41aHPM-g8ZMDUeRvdzpikN1B4CnOWjRmTYLHiX4", "secret":0, "shield_comment_notice":0, "shield_digg_notice":0, "shield_follow_notice":0, "short_id":"590836693", "show_image_bubble":false, "signature":"社会", "special_lock":1, "status":1, "stitch_setting":0, "story_count":0, "story_open":false, "sync_to_toutiao":0, "total_favorited":0, "tw_expire_time":0, "twitter_id":"", "twitter_name":"", "type_label":null, "uid":"83981829524", "unique_id":"", "unique_id_modify_time":1600095491, "user_canceled":false, "user_mode":0, "user_period":0, "user_rate":1, "user_tags":null, "verification_type":1, "verify_info":"", "video_icon":{ "height":720, "uri":"", "url_list":[ ], "width":720 }, "weibo_name":"", "weibo_schema":"", "weibo_url":"", "weibo_verify":"", "white_cover_url":null, "with_commerce_entry":false, "with_dou_entry":false, "with_fusion_shop_entry":false, "with_shop_entry":false, "youtube_channel_id":"", "youtube_channel_title":"", "youtube_expire_time":0 }, "user_buried":false, "user_digged":0 }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "cursor":10, "extra":{ "fatal_item_ids":null, "now":1600095491000 }, "has_more":1, "hotsoon_filtered_count":0, "hotsoon_has_more":1, "hotsoon_text":"残余评论因未受权抖音短视频，暂不反对查看", "log_pb":{ "impr_id":"202009142258100101980820732B2EBFD5" }, "reply_style":2, "status_code":0, "total":102357 }, "msg":"success"}

November 10, 2020 · 2 min · jiezi

关于大数据:微信视频号播主排行榜2020年10月

TiToData，业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博 须要更多数据、Excel请分割： > TiToData

November 9, 2020 · 1 min · jiezi

关于大数据:抖音快手等全平台视频去水印解析大全

抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博无广告通用：https://vip.52jiexi.top/?url= 腾讯直解无广告解析：https://jx.lfeifei.cn/?url= 无广告解析：https://api.steak517.top/?url= 秒播无广告解析：http://api.steak517.top/?url=无广告通用HTTP接口 ：http://api.yueliangjx.com/?url=无广告通用HTTPS接口：https://api.yueliangjx.com/?url=无广告解析：https://jx.elwtc.com/vip/?url=无广告解析：https://api.78sy.cn/?url= 秒播无广告通用HTTP接口 ：http://www.2ajx.com/vip.php?url=无广告通用HTTPS接口：https://www.2ajx.com/vip.php?url=通用HTTP接口 ：http://api.steak517.top/?url=通用HTTPS接口：https://api.steak517.top/?url=https://vip.ikjiexi.top/api/?url= 无广告，速度也还行https://www.kpezp.cn/jlexi.php?url= 速度挺快的*还带记忆播放https://api.8bjx.cn/?url= 秒播吧 记忆https://jx.f41.cc/?url= 速度还能够http://v.nmbaojie.com/mingri/mingri.php?url=速度还行https://www.ckmov.vip/api.php?url= 挺快的http://jx.ejiafarm.com/dy.php?url= 挺快的https://jx.youyitv.com/?url=http://jiexi.xueshi.prohttps://z1.m1907.cn/?jx= 小卡https://jx.618g.com/?url= 速度个别https://www.1717yun.com/jx/ty.php?url= 速度还能够https://cdn.yangju.vip/k/?url= 个别https://vip.jaoyun.com/index.php?url= 还能够https://jx.618g.com/?url= 还能够https://www.myxin.top/jx/api/?url= 腾讯直解 缓存挺快的https://jiexi.071811.cc/jx.php?url= 挺快的https://jx.wslmf.com/?url= 还行就是 不带缓存要拉快进的留神了https://jx.dy-jx.com/?url= 打不开https://vip.mpos.ren/v/?url=黑屏https://jqaaa.com/jx.php?url= 速度挺快的https://jx.598110.com/index.php?url= 速度还能够https://jx.bwcxy.com/?v= 速度还能够https://jx.rdhk.net/?v= 速度个别https://jx.fo97.cn/?url= 如同不能用https://jx.ivito.cn/?url= 个别https://api.927jx.com/vip/?url=一般般https://api.tv920.com/vip/?url=很个别https://api.lhh.la/vip/?url=https://api.sumingys.com/index.php?url= 很个别https://cn.bjbanshan.cn/jx.php?url=挺快的https://jx.mw0.cc/?url=挺快的https://www.33tn.cn/?url= 挺快的http://jx.1ff1.cn/?url= 还行https://jx.000180.top/jx/?url= 个别https://py.ha12.xyz/sos/index.php?url=https://jiexi.380k.com/?url= 挺快的https://jx.wslmf.com/?url= 挺快的https://okjx.cc/?url=间接观看http://tv.inkb.ink/index.html扫码http://www.guandianzhiku.com/v/s/?url=https://v.7cyd.com/vip/?url=腾讯视频 慢http://zxjx.00vb.com/zdhx/index.php?url=https://www.jqaaa.com/jx.php?url=无广告超清解析：jx.awx88.cn/jiexi/?url=弹幕解析：gongxiangtv.cn/?url=###VIP视频解析VIP视频解析北极XS 视频解析：http://beijixs.cn/ 视频高清116kan智能解析：https://vip.116kan.com/ 高清视频365t在線免費解析觀看系統：http://vip.365tol.top/BL智能解析：https://vip.bljiex.com/kingtail智能解析：https://jx.kingtail.xyz/?url=https://jsap.attakids.com/?url=https://api.lnwu.net/?url=91视频解析：https://www.91jxs.com/jiexi/?url=https://api.jhys.top/?url=思古视频服务：https://api.sigujx.com/?url=小野马解析：https://www.xymav.com/?url=诺讯智能解析：https://www.nxflv.com/?url=热搜视频：https://v.resoumen.com/全民解析：http://qmaile.com/ 解析聚合，多线路解析聚神铺vip解析：http://www.jspoo.com/vip.html 解析聚合，多线路抉择Yun Parse视频云解析：http://120.27.155.106/ 填视频ID而不是视频网页地址，另反对解析QQ相册等地址爱看解析：http://tv.vipsli.com/TVB云播全网VIP视频解析：http://vip.hktvyb.com/ 聚合解析，多线路Playm3u8解析：https://www.playm3u8.cn/jiexi.php?url= 除了常见VIP视频地址外，还反对解析QQ相册等地址千亿解析：https://www.qianyicp.com/jiexi/index.php?url= 蓝光超清解析接口OK解析：http://www.okjx.cc/ceshi/ 不太清晰618G收费解析：https://jx.618g.com/ 不是很清晰http://avip.fun/tv?utm_source=不清晰

November 9, 2020 · 1 min · jiezi

关于大数据:抖音直播Api

抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博直播间信息申请Apihttp://主机地址/douyin/liveroom/info?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": { "AnchorABMap": { }, "admin_user_ids": [ ], "anchor_scheduled_time_text": "", "anchor_share_text": "#在抖音，记录美好生活#【小鱼家服饰1店】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "anchor_tab_type": 0, "app_id": 0, "auto_cover": 0, "base_category": 0, "book_end_time": 0, "book_time": 0, "business_live": 1, "category": 0, "cell_style": 3, "challenge_info": "", "client_version": 110500, "comment_box": { "placeholder": "说点什么..." }, "comment_name_mode": 0, "common_label_list": "", "content_tag": "", "cover": { "avg_color": "#EBE1CE", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/6819084786280876808", "url_list": [ "http://p9-webcast-dycdn.byteimg.com/img/webcast/6819084786280876808~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/6819084786280876808~tplv-obj.image" ], "width": 0 }, "create_time": 1593306241, "deco_list": [ ], "distance": "", "distance_city": "", "distance_km": "", "dynamic_cover_dict": { }, "dynamic_cover_uri": "", "enable_room_perspective": false, "fansclub_msg_style": 2, "fcdn_appid": 0, "feed_room_label": { "avg_color": "#A3967C", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/2ea90002aca1159b5c67", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image" ], "width": 0 }, "finish_reason": 0, "finish_time": 1593362656, "finish_url": "", "follow_msg_style": 2, "forum_extra_data": "", "gift_msg_style": 2, "group_id": 0, "group_source": 0, "guide_button": { "avg_color": "#7A5353", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_button_togather_3x.png", "url_list": [ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image" ], "width": 0 }, "has_commerce_goods": true, "hot_sentence_info": "", "id": 6843198199583378191, "id_str": "6843198199583378191", "introduction": "", "is_replay": false, "is_show_inquiry_ball": false, "is_show_user_card_switch": true, "last_ping_time": 0, "layout": 0, "like_count": 4746, "linker_map": { }, "linkmic_layout": 1, "live_distribution": [ ], "live_id": 1, "live_type_audio": false, "live_type_linkmic": false, "live_type_normal": true, "live_type_official": false, "live_type_sandbox": false, "live_type_screenshot": false, "live_type_third_party": false, "living_room_attrs": { "admin_flag": 0, "rank": 0, "room_id": 6843198199583378191, "room_id_str": "6843198199583378191", "silence_flag": 0 }, "location": "", "lottery_finish_time": 0, "luckymoney_num": 0, "mosaic_status": 0, "mosaic_tip": "", "orientation": 0, "os_type": 1, "owner": { "adversary_authorization_info": 1, "adversary_user_status": 0, "allow_be_located": false, "allow_find_by_contacts": false, "allow_others_download_video": false, "allow_others_download_when_sharing_video": false, "allow_share_show_profile": false, "allow_show_in_gossip": false, "allow_show_my_action": false, "allow_strange_comment": false, "allow_unfollower_comment": false, "allow_use_linkmic": false, "authentication_info": { "authentication_badge": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/authentication_icon.png", "url_list": [ "http://p3-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width": 0 }, "custom_verify": "", "enterprise_verify_reason": "六安裕安星期八服装经营部" }, "authorization_info": 3, "avatar_large": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "1080x1080/3110f00056c0567624bbb", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "avatar_medium": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "720x720/3110f00056c0567624bbb", "url_list": [ "https://p29-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "avatar_thumb": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "100x100/3110f00056c0567624bbb", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "badge_image_list": [ { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_5.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image" ], "width": 32 } ], "bg_img_url": "", "birthday": 0, "birthday_description": "", "birthday_valid": false, "block_status": 0, "city": "", "comment_restrict": 0, "commerce_webcast_config_ids": [ ], "constellation": "", "create_time": 0, "disable_ichat": 0, "display_id": "xiaoyu58888", "enable_ichat_img": 0, "exp": 0, "experience": 0, "fan_ticket_count": 0, "fans_club": { "data": { "anchor_id": 0, "available_gift_ids": [ ], "badge": { "icons": { "0": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "", "url_list": [ ], "width": 0 } }, "title": "" }, "club_name": "", "level": 0, "user_fans_club_status": 0 }, "prefer_data": { } }, "fold_stranger_chat": false, "follow_info": { "follow_status": 0, "follower_count": 214171, "following_count": 7, "push_status": 0 }, "follow_status": 0, "gender": 2, "hotsoon_verified": false, "hotsoon_verified_reason": "", "ichat_restrict_type": 0, "id": 95760275230, "id_str": "95760275230", "income_share_percent": 0, "is_follower": false, "is_following": false, "level": 0, "link_mic_stats": 1, "media_badge_image_list": [ ], "modify_time": 1600068668, "need_profile_guide": false, "new_real_time_icons": [ ], "nickname": "小鱼家服饰1店", "pay_grade": { "grade_banner": "", "grade_describe": "间隔6级还差17抖币", "grade_icon_list": [ ], "level": 5, "name": "", "new_im_icon_with_level": { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_5.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image" ], "width": 32 }, "new_live_icon": { "avg_color": "", "height": 12, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_pay_grade_2x_5_9.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_5_9.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_5_9.png~tplv-obj.image" ], "width": 12 }, "next_diamond": 0, "next_name": "", "next_privileges": "", "now_diamond": 0, "pay_diamond_bak": 0, "score": 48, "screen_chat_type": 0, "this_grade_max_diamond": 65, "this_grade_min_diamond": 45, "total_diamond_count": 48, "upgrade_need_consume": 0 }, "pay_score": 48, "pay_scores": 0, "push_comment_status": false, "push_digg": false, "push_follow": false, "push_friend_action": false, "push_ichat": false, "push_status": false, "push_video_post": false, "push_video_recommend": false, "real_time_icons": [ ], "sec_uid": "MS4wLjABAAAAKp0OuO92yhbvfneuhthk-gskWF0f_JD1W3LRVltoEkc", "secret": 0, "share_qrcode_uri": "7b85001cb87e09f40e06", "short_id": 830360786, "signature": "卖衣服的小鱼儿", "special_id": "", "status": 1, "telephone": "", "ticket_count": 1890, "top_fans": [ ], "top_vip_no": 0, "total_recharge_diamond_count": 0, "user_attr": { "is_admin": false, "is_muted": false, "is_super_admin": false }, "user_role": 0, "verified": true, "verified_content": "", "verified_mobile": false, "verified_reason": "", "with_car_management_permission": false, "with_commerce_permission": true, "with_fusion_shop_entry": true }, "owner_device_id": 0, "owner_user_id": 95760275230, "popularity": 0, "popularity_str": "", "pre_enter_time": 0, "preview_copy": "世界很大，但咱们很有缘~", "preview_flow_tag": 0, "private_info": "", "ranklist_audience_type": 0, "real_distance": "", "relation_tag": "", "replay": false, "replay_location": 0, "room_audit_status": 0, "room_auth": { "AudioChat": 2, "Banner": 1, "Chat": true, "CommerceCard": 1, "Danmaku": false, "DanmakuDefault": 0, "Digg": true, "DonationSticker": 2, "Gift": true, "GiftAnchorMt": 0, "HourRank": 0, "Landscape": 1, "LandscapeChat": 1, "LuckMoney": true, "MoreAnchor": 1, "POI": true, "Props": true, "PublicScreen": 1, "RecordScreen": 0, "RoomContributor": true, "Share": 1, "UserCard": true, "UserCorner": 1 }, "room_create_ab_param": "", "room_layout": 0, "room_tabs": [ ], "room_tag": 0, "scroll_config": "", "search_id": 0, "sell_goods": false, "share_msg_style": 2, "share_url": "https://webcast.amemv.com/webcast/reflow/6843198199583378191", "short_title": "", "short_touch_area_config": { "elements": { "1": { "priority": 0, "type": 1 }, "2": { "priority": 0, "type": 2 }, "3": { "priority": 0, "type": 3 }, "4": { "priority": 2, "type": 4 }, "5": { "priority": 3, "type": 5 }, "6": { "priority": 2, "type": 6 }, "7": { "priority": 2, "type": 7 }, "8": { "priority": 2, "type": 8 }, "9": { "priority": 2, "type": 9 }, "10": { "priority": 2, "type": 10 }, "12": { "priority": 2, "type": 12 } } }, "stamps": "", "start_time": 1593306245, "stats": { "digg_count": 0, "dou_plus_promotion": "", "enter_count": 0, "fan_ticket": 0, "follow_count": 2612, "gift_uv_count": 26, "id": 6843198199583378191, "id_str": "6843198199583378191", "like_count": 0, "money": 0, "total_user": 164069, "total_user_desp": "", "user_count_composition": { "city": 0, "my_follow": 0.02, "other": 0.27, "video_detail": 0.71 }, "watermelon": 0 }, "status": 4, "stream_close_time": 0, "stream_id": 683385719577641061, "stream_id_str": "683385719577641061", "stream_provider": 0, "stream_url": { "candidate_resolution": [ ], "complete_push_urls": [ ], "default_resolution": "ORIGION", "extra": { "anchor_interact_profile": 0, "audience_interact_profile": 0, "bframe_enable": false, "bitrate_adapt_strategy": 0, "bytevc1_enable": false, "default_bitrate": 800, "fps": 15, "gop_sec": 0, "h265_enable": false, "hardware_encode": false, "height": 640, "max_bitrate": 1333, "min_bitrate": 512, "roi": false, "sw_roi": false, "video_profile": 0, "width": 368 }, "flv_pull_url": { }, "flv_pull_url_params": { }, "hls_pull_url": "http://pull-hls-f11.douyincdn.com/stage/stream-683385719577641061.m3u8", "hls_pull_url_map": { }, "hls_pull_url_params": "{\"VCodec\":\"h264\"}", "id": 683385719577641061, "id_str": "683385719577641061", "live_core_sdk_data": { "pull_data": { "options": { "default_quality": { "level": 0, "name": "超清", "resolution": "", "sdk_key": "origin", "v_codec": "" }, "qualities": [ { "level": 3, "name": "超清", "resolution": "720x1280", "sdk_key": "origin", "v_codec": "264" } ] }, "stream_data": "{\"common\":{\"session_id\":\"037-20200914230522010021067202095FE415\"},\"data\":{\"origin\":{\"main\":{\"flv\":\"http://pull-flv-f11.douyincdn.com/stage/stream-683385719577641061.flv\",\"hls\":\"http://pull-hls-f11.douyincdn.com/stage/stream-683385719577641061.m3u8\",\"cmaf\":\"\",\"dash\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":4,\\\"resolution\\\":\\\"720x1280\\\",\\\"vbitrate\\\":909728000}\"}}}}" }, "push_data": { "push_stream_level": 0, "resolution_params": { "ld": { "default_bitrate": 800000, "fps": 15, "height": 848, "max_bitrate": 1333000, "min_bitrate": 320000, "width": 480 }, "sd": { "default_bitrate": 1000000, "fps": 15, "height": 960, "max_bitrate": 1600000, "min_bitrate": 500000, "width": 540 } } } }, "provider": 0, "push_urls": [ ], "resolution_name": { "FULL_HD1": "蓝光", "HD1": "超清", "ORIGION": "原画", "SD1": "标清", "SD2": "高清" }, "rtmp_pull_url": "http://pull-flv-f11.douyincdn.com/stage/stream-683385719577641061.flv", "rtmp_pull_url_params": "{\"VCodec\":\"h264\"}", "rtmp_push_url": "", "rtmp_push_url_params": "", "stream_control_type": 0 }, "sun_daily_icon_content": "", "tags": [ ], "title": "小鱼家????服饰正在直播", "top_fans": [ ], "use_filter": false, "user_count": 0, "user_share_text": "#在抖音，记录美好生活#【小鱼家服饰1店】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "vertical_cover_uri": "", "vid": "", "video_feed_tag": "直播中", "wait_copy": "失去急躁的期待将幸福擦肩而过", "web_count": 0, "webcast_comment_tcs": 0, "webcast_sdk_version": 0, "with_draw_something": false, "with_ktv": false, "with_linkmic": false }, "extra": { "now": 1600095922450 }, "status_code": 0 }, "msg": "success"}弹幕/关注/送礼/点赞/来了 实时获取申请Apihttp://主机地址/douyin/liveroom/chat?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": [ { "type": "WebcastSocialMessage", "nickname": "薛莲", "uid": "111265487875", "short_id": "2072651305", "msg_id": "6843261579299965709", "sec_uid": "\"MS4wLjABAAAAmpM-hJ8AeUM8hSc3w5YlY8Q2ZUaiEu7uvt6cApLkyjg\"", "msg": "关注了主播" }, { "type": "WebcastMemberMessage", "nickname": "用户5121651744892", "uid": "3654415794833197", "short_id": "2980367364", "msg_id": "6843261580051155719", "sec_uid": "\"MS4wLjABAAAAYcAoC-U8hSeyUxnGx_i5yoHRPPfwtr2wfplWg9KGsSMXyi7pWlPMV6XwMX7xpDgK\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "大姑", "uid": "3091436132641739", "short_id": "2372670321", "msg_id": "6843261580789320462", "sec_uid": "\"MS4wLjABAAAAws0M9rKV7kK1ayWZ31Ebjsd8SwFI0rdf8goPY7HI8tELNK1XkFpX25yvHqe8WY9d\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "我有一个好名字", "uid": "98675983627", "short_id": "1144452894", "msg_id": "6843261580508433159", "sec_uid": "\"MS4wLjABAAAAQhMqocOlzOLFvUE0tJKLQWKx1QuP8YXQmI2A6L3kWLQ\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "李祥林", "uid": "2946292105354829", "short_id": "3496282621", "msg_id": "6843261585180560136", "sec_uid": "\"MS4wLjABAAAAcFKemBUvCP-CppApJZsS_4FEuIAWf2_2fpyrcsrs1PZi4U0PyXOK-3qRy4dVnAWW\"", "msg": "来了" }, { "type": "WebcastChatMessage", "uid": "4006248980690445", "tid": "6843260054435826435", "nickname": "幸福", "text": "我不会买", "sec_uid": "MS4wLjABAAAAZWY-mQkfFitGRzNztj2FwNI6EJL6VJhEwuy3ehDmsVNBst1E2dU4umtJKmX4VW5S", "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2dbd70006de205b08161b.jpeg?from=4010531038" }, { "type": "WebcastMemberMessage", "nickname": "双子座一半天使，一半恶魔的陈欣彤????????", "uid": "945180703722141", "short_id": "2789104616", "msg_id": "6843261584941288205", "sec_uid": "\"MS4wLjABAAAAwvMatTP6mPsnysD0IPVmALci4CsfvRgOUi7lJxzq-c8\"", "msg": "来了" } ], "msg": 'success'}直播间带货商品列表申请Apihttp://主机地址/douyin/liveroom/promotions?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code":200, "data":{ "current_promotion_id":"3436129527946972390", "entries":[ { "icon":"http://p3.pstatp.com/origin/321f50008dae87efe41ce", "title":"订单", "type":2, "url":"aweme://webview/?url=https%3A%2F%2Faweme.snssdk.com%2Ffalcon%2Fe_commerce%2Frn%2Forder_dashboard%2F%3Fstatus_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26enter_from%3Dlive_list_card%26origin_type%3D9902106000&status_font_dark=0&hide_nav_bar=1&loading_bgcolor=161823&should_full_screen=1&enter_from=live_list_card&origin_type=9902106000&rn_schema=aweme%3A%2F%2Freactnative%2F%3Fmodule_name%3Dpage_order_dashboard%26status_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26channel%3Dfe_lyon_order_dashboard%26bundle%3Dindex.js%26enter_from%3Dlive_list_card%26origin_type%3D9902106000" } ], "expire_time":300000, "flash_total":0, "has_more":false, "min_refresh_gap":10000, "next_page_id":"", "promotions":[ Object{...}, { "app_type":0, "app_url":"", "apply_coupon":0, "button_label":"去购买", "campaign":false, "can_explain":true, "can_seckill":false, "cos_fee":0, "cos_ratio":0, "coupons":[ ], "cover":"https://sf6-ttcdn-tos.pstatp.com/img/temai/4d79a9bc80b64c9ffd9412fc45f59c9bwww850-850~tplv-resize:200:0.webp", "detail_url":"aweme://goods/seeding/?promotion_id=3436129527946972390&product_id=3436129527946972390&target_uid=3773170526723102&item_id=0&source_page=live&sec_target_uid=MS4wLjABAAAAtvPLMdtyUwsz7C5mYnFRnpVzkJTC4k_AGxjfPhzu8dWQymu9_lzXPHMXp1q5gnGj&meta_param={"enter_from":"live","live_room_id":"6872323400263797518"}&carrier_type=&entrance_info=", "elastic_title":"", "event_param":{ }, "extra":{ "coupon_min_price":"0", "start_time":"0" }, "flash_icon":"", "flash_type":0, "in_stock":true, "index":2, "item_type":6, "label_icon":"https://sf1-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/explain_new.png", "min_price":5990, "next_page":"split", "order_url":"", "platform":4, "platform_icon":"https://sf6-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/platform_xiaodian.png", "platform_label":"小店", "price":99900, "product_id":"3436129527946972390", "promotion_id":"3436129527946972390", "promotion_source":[ ], "sale_num":0, "shop_id":3494225, "short_half_url":"", "short_title":"", "skip_style":0, "status":2, "stock_num":0, "title":"k00006三色显瘦牛仔裤" } ], "room_type":0, "show_begin_time":0, "show_duration":0, "status_code":0, "status_msg":"", "top_limit":100, "total":31 }, "msg":"success"}开播查问申请Apihttp://主机地址/douyin/liveroom/status?token=xxx&room_id=6843198199583378191,6872323400263797518申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": [ { "alive": false, "room_id": 6843198199583378191 }, { "alive": true, "room_id": 6872323400263797518 } ], "extra": { "now": 1600096174925 }, "status_code": 0 }, "msg": "success"}在线观众申请Apihttp://主机地址/douyin/liveroom/audience?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": { "currency": "音浪", "has_more": false, "has_once_live": true, "music_wave": "音浪", "ranks": [ { "delta": 0, "first_gift": false, "gap_description": "99", "rank": 1, "score": 99, "user": { "adversary_authorization_info": 0, "adversary_user_status": 0, "allow_be_located": false, "allow_find_by_contacts": false, "allow_others_download_video": false, "allow_others_download_when_sharing_video": false, "allow_share_show_profile": false, "allow_show_in_gossip": false, "allow_show_my_action": false, "allow_strange_comment": false, "allow_unfollower_comment": false, "allow_use_linkmic": false, "authorization_info": 3, "avatar_thumb": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "100x100/316e3000c72bee4420e2d", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038" ], "width": 0 }, "badge_image_list": [], "bg_img_url": "", "birthday": 0, "birthday_description": "", "birthday_valid": false, "block_status": 0, "city": "", "comment_restrict": 0, "commerce_webcast_config_ids": [], "constellation": "", "create_time": 0, "disable_ichat": 0, "display_id": "385190430", "enable_ichat_img": 0, "exp": 0, "experience": 0, "fan_ticket_count": 0, "fans_club": { "data": { "anchor_id": 0, "available_gift_ids": [], "badge": { "icons": { "0": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "", "url_list": [], "width": 0 } }, "title": "" }, "club_name": "", "level": 0, "user_fans_club_status": 0 }, "prefer_data": {} }, "fold_stranger_chat": false, "follow_info": { "follow_status": 0, "follower_count": 0, "following_count": 0, "push_status": 0 }, "follow_status": 0, "gender": 0, "hotsoon_verified": false, "hotsoon_verified_reason": "", "ichat_restrict_type": 0, "id": 66287019758, "id_str": "66287019758", "income_share_percent": 0, "is_follower": false, "is_following": false, "level": 0, "link_mic_stats": 0, "media_badge_image_list": [], "modify_time": 0, "need_profile_guide": false, "new_real_time_icons": [], "nickname": "吉森", "pay_grade": { "grade_banner": "", "grade_describe": "间隔17级还差3抖币", "grade_icon_list": [], "level": 16, "name": "", "new_im_icon_with_level": { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_16.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image" ], "width": 32 }, "new_live_icon": { "avg_color": "", "height": 12, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_pay_grade_2x_15_19.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image" ], "width": 12 }, "next_diamond": 0, "next_name": "", "next_privileges": "", "now_diamond": 0, "pay_diamond_bak": 0, "score": 1697, "screen_chat_type": 0, "this_grade_max_diamond": 1700, "this_grade_min_diamond": 1300, "total_diamond_count": 1697, "upgrade_need_consume": 0 }, "pay_score": 0, "pay_scores": 0, "push_comment_status": false, "push_digg": false, "push_follow": false, "push_friend_action": false, "push_ichat": false, "push_status": false, "push_video_post": false, "push_video_recommend": false, "real_time_icons": [], "sec_uid": "MS4wLjABAAAABkK4jcEax0iVyUVnrSH3Q63wM6vRb_OlpK0Zd9DbcwE", "secret": 0, "share_qrcode_uri": "", "short_id": 385190430, "signature": "", "special_id": "", "status": 0, "telephone": "", "ticket_count": 0, "top_fans": [], "top_vip_no": 0, "total_recharge_diamond_count": 0, "user_role": 0, "verified": false, "verified_content": "", "verified_mobile": false, "verified_reason": "", "with_car_management_permission": false, "with_commerce_permission": false, "with_fusion_shop_entry": false } }, ], "rules_url": "sslocal://webcast_webview?url=https%3A%2F%2Faweme.snssdk.com%2Fmagic%2Fpage%2Fejs%2F5f27c6ca9950ec0307de9248%3FappType%3Ddouyin%26pull_down_indicator_color%3Ddark%26pull_down_indicator_not_show%3D0%26web_bg_color%3D%2523ffffffff&pull_down_close=0&pull_down_indicator_not_show=1&pull_down_indicator_color=dark&type=popup&gravity=bottom&height=450&radius=8&hide_more=0&hide_nav_bar=0&hide_status_bar=0&landscape_custom_width=1&rate_height=450", "seats": [], "self_info": { "delta": 0, "first_gift": false, "gap_description": "本场奉献：0音浪", "rank": 0, "score": 0 }, "total": 0 }, "extra": { "now": 1600957337628 }, "status_code": 0 }, "msg": "success"}随机举荐申请Apihttp://主机地址/douyin/liveroom/feed?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "data":[ { "AnchorABMap":{ }, "admin_user_ids":[ 99861659499, 52271736462, 1011196253964014, 96403313823, 101799896778, 103146623893, 105895303173, 2084292323972430, 1103515168282891, 106708685343 ], "anchor_scheduled_time_text":"", "anchor_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "anchor_tab_type":0, "app_id":0, "auto_cover":0, "base_category":0, "book_end_time":0, "book_time":0, "business_live":0, "category":0, "cell_style":3, "challenge_info":"", "client_version":120400, "comment_box":{ "placeholder":"说点什么..." }, "comment_name_mode":0, "common_label_list":"", "content_tag":"语音互动", "cover":{ "avg_color":"#A3A3CC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/6825919466414000909", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image" ], "width":0 }, "create_time":1600093069, "deco_list":[ ], "distance":"", "distance_city":"", "distance_km":"", "dynamic_cover_dict":{ }, "dynamic_cover_uri":"", "enable_room_perspective":true, "fansclub_msg_style":0, "fcdn_appid":0, "feed_room_label":{ "avg_color":"#E0D4BC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/2ea90002aca1159b5c67", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image" ], "width":0 }, "finish_reason":0, "finish_time":1600096193, "finish_url":"", "follow_msg_style":0, "forum_extra_data":"", "gift_msg_style":0, "group_id":0, "group_source":22, "guide_button":{ "avg_color":"#7A5353", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_button_togather_3x.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image" ], "width":0 }, "has_commerce_goods":true, "hot_sentence_info":"", "id":6872347400942570254, "id_str":"6872347400942570254", "introduction":"", "is_replay":false, "is_show_inquiry_ball":false, "is_show_user_card_switch":true, "last_ping_time":0, "layout":0, "like_count":92949, "linker_map":{ }, "linkmic_layout":1, "live_distribution":[ ], "live_id":1, "live_type_audio":false, "live_type_linkmic":false, "live_type_normal":true, "live_type_official":false, "live_type_sandbox":false, "live_type_screenshot":false, "live_type_third_party":false, "living_room_attrs":{ "admin_flag":0, "rank":0, "room_id":6872347400942570254, "room_id_str":"6872347400942570254", "silence_flag":0 }, "location":"", "lottery_finish_time":0, "luckymoney_num":0, "mosaic_status":0, "mosaic_tip":"", "orientation":0, "os_type":1, "owner":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authentication_info":{ "authentication_badge":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/authentication_icon.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width":0 }, "custom_verify":"抖音音乐人", "enterprise_verify_reason":"" }, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/3109c00018629796e0bbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"上海", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"hanyu8866", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":88159, "following_count":272, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":53116625314, "id_str":"53116625314", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600095187, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"君少????", "own_room":{ "room_ids":[ 6872347400942570000 ], "room_ids_str":[ "6872347400942570254" ] }, "pay_grade":{ "grade_banner":"", "grade_describe":"间隔11级还差76抖币", "grade_icon_list":[ ], "level":10, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_10_14.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":234, "screen_chat_type":0, "this_grade_max_diamond":310, "this_grade_min_diamond":230, "total_diamond_count":234, "upgrade_need_consume":0 }, "pay_score":234, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA3MeJAw6E5g0nxsRGlIwlHEVyhjGYcZPQST_y4Zqt9xw", "secret":0, "share_qrcode_uri":"671000112a883c693062", "short_id":379542891, "signature":"????开播工夫：晚21:00～2:00 (偶然提早请谅解下）????直播内容: 唱歌, 风趣, 老歌, 新歌, 心灵, 情感生活..????酷????搜君少 关注下哈, 惟一抖音号其余假冒非自己????身高182:体重135:保持做个好的操行内外兼修的人????小视频全副自己现录现场, 5级粉丝团➕V❤V????", "special_id":"", "status":1, "telephone":"", "ticket_count":52070102, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":true, "with_fusion_shop_entry":true }, "owner_device_id":0, "owner_user_id":53116625314, "popularity":0, "popularity_str":"", "pre_enter_time":0, "preview_copy":" 昨天擦肩而过，明天不再错过~", "preview_flow_tag":0, "private_info":"", "ranklist_audience_type":0, "real_distance":"", "relation_tag":"", "replay":true, "replay_location":0, "room_audit_status":0, "room_auth":{ "AudioChat":0, "Banner":1, "Chat":true, "CommerceCard":1, "Danmaku":false, "DanmakuDefault":1, "Digg":true, "DonationSticker":2, "Gift":true, "GiftAnchorMt":1, "HourRank":0, "Landscape":1, "LandscapeChat":1, "LuckMoney":true, "MoreAnchor":1, "POI":true, "Props":true, "PublicScreen":1, "RecordScreen":2, "RoomContributor":true, "Share":1, "UserCard":true, "UserCorner":1 }, "room_create_ab_param":"", "room_layout":0, "room_tabs":[ ], "room_tag":0, "scroll_config":"", "search_id":0, "sell_goods":false, "share_msg_style":0, "share_url":"https://webcast.amemv.com/webcast/reflow/6872347400942570254", "short_title":"", "short_touch_area_config":{ "elements":{ "1":{ "priority":0, "type":1 }, "2":{ "priority":0, "type":2 }, "3":{ "priority":0, "type":3 }, "4":{ "priority":2, "type":4 }, "5":{ "priority":3, "type":5 }, "6":{ "priority":2, "type":6 }, "7":{ "priority":2, "type":7 }, "8":{ "priority":2, "type":8 }, "9":{ "priority":2, "type":9 }, "10":{ "priority":2, "type":10 }, "12":{ "priority":2, "type":12 } } }, "stamps":"", "start_time":0, "stats":{ "digg_count":0, "dou_plus_promotion":"", "enter_count":0, "fan_ticket":35487, "follow_count":130, "gift_uv_count":114, "id":6872347400942570254, "id_str":"6872347400942570254", "like_count":0, "money":0, "total_user":19291, "total_user_desp":"", "user_count_composition":{ "city":0, "my_follow":0.02, "other":0.54, "video_detail":0.43 }, "watermelon":0 }, "status":2, "stream_close_time":0, "stream_id":107380421578457227, "stream_id_str":"107380421578457227", "stream_provider":0, "stream_url":{ "candidate_resolution":[ ], "complete_push_urls":[ ], "default_resolution":"ORIGION", "extra":{ "anchor_interact_profile":0, "audience_interact_profile":0, "bframe_enable":false, "bitrate_adapt_strategy":0, "bytevc1_enable":false, "default_bitrate":800, "fps":15, "gop_sec":0, "h265_enable":false, "hardware_encode":false, "height":1280, "max_bitrate":1333, "min_bitrate":512, "roi":false, "sw_roi":false, "video_profile":0, "width":720 }, "flv_pull_url":{ }, "flv_pull_url_params":{ }, "hls_pull_url":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8", "hls_pull_url_map":{ }, "hls_pull_url_params":"{"VCodec":"h264"}", "id":107380421578457227, "id_str":"107380421578457227", "live_core_sdk_data":{ "pull_data":{ "options":{ "default_quality":{ "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" }, "qualities":[ { "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" } ] }, "stream_data":"{"common":{"session_id":"037-202009142310030100120330321750DAD3"},"data":{"origin":{"main":{"flv":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv","hls":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8","cmaf":"","dash":"","sdk_params":"{\"VCodec\":\"h264\",\"gop\":4,\"resolution\":\"or4\",\"vbitrate\":0}"}}}}" } }, "provider":0, "push_urls":[ ], "resolution_name":{ "FULL_HD1":"蓝光", "HD1":"超清", "ORIGION":"原画", "SD1":"标清", "SD2":"高清" }, "rtmp_pull_url":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv", "rtmp_pull_url_params":"{"VCodec":"h264"}", "rtmp_push_url":"", "rtmp_push_url_params":"", "stream_control_type":0 }, "sun_daily_icon_content":"", "tags":[ ], "title":"人帅歌美☘️正能量", "top_fans":[ { "fan_ticket":10400, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"dyru1g558bhr", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":57, "following_count":31, "push_status":0 }, "follow_status":0, "gender":2, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":1103515168282891, "id_str":"1103515168282891", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1599832509, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"雅玉", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔46级还差50.0w抖币", "grade_icon_list":[ ], "level":45, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_45_49.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":4000225, "screen_chat_type":0, "this_grade_max_diamond":4500000, "this_grade_min_diamond":3400000, "total_diamond_count":4000225, "upgrade_need_consume":0 }, "pay_score":4000225, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA1iOTCLUnU0ltsnYC-NIh3dIkse2of0cgJxeM9w7P102k8xK4TtEeAvyAnSg6hOys", "secret":1, "share_qrcode_uri":"31166000284aa5924b352", "short_id":3589316171, "signature":"我不能扭转生命的长度，但我能够把握生命的宽度！ 断、舍、离。 断：把不高兴的所有事件从脑海里删除。 舍：把心里面的垃圾定期的解决掉。 离：放过本人放空本人，才会有机会贮存高兴的空间。", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } } ], "use_filter":false, "user_count":1083, "user_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "vertical_cover_uri":"", "vid":"", "video_feed_tag":"直播中", "wait_copy":"失去急躁的期待将幸福擦肩而过", "web_count":0, "webcast_comment_tcs":0, "webcast_sdk_version":0, "with_draw_something":false, "with_ktv":false, "with_linkmic":false } ], "extra":{ "now":1600096204128 }, "status_code":0 }, "msg":"success"}

November 9, 2020 · 13 min · jiezi

关于大数据:抖音直播监控Api随机推荐

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/feed?token=xxx申请形式GET参数字段类型阐明tokenstring接口受权码返回示例{ "code":200, "data":{ "data":[ { "AnchorABMap":{ }, "admin_user_ids":[ 99861659499, 52271736462, 1011196253964014, 96403313823, 101799896778, 103146623893, 105895303173, 2084292323972430, 1103515168282891, 106708685343 ], "anchor_scheduled_time_text":"", "anchor_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "anchor_tab_type":0, "app_id":0, "auto_cover":0, "base_category":0, "book_end_time":0, "book_time":0, "business_live":0, "category":0, "cell_style":3, "challenge_info":"", "client_version":120400, "comment_box":{ "placeholder":"说点什么..." }, "comment_name_mode":0, "common_label_list":"", "content_tag":"语音互动", "cover":{ "avg_color":"#A3A3CC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/6825919466414000909", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/6825919466414000909~tplv-obj.image" ], "width":0 }, "create_time":1600093069, "deco_list":[ ], "distance":"", "distance_city":"", "distance_km":"", "dynamic_cover_dict":{ }, "dynamic_cover_uri":"", "enable_room_perspective":true, "fansclub_msg_style":0, "fcdn_appid":0, "feed_room_label":{ "avg_color":"#E0D4BC", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/2ea90002aca1159b5c67", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image" ], "width":0 }, "finish_reason":0, "finish_time":1600096193, "finish_url":"", "follow_msg_style":0, "forum_extra_data":"", "gift_msg_style":0, "group_id":0, "group_source":22, "guide_button":{ "avg_color":"#7A5353", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_button_togather_3x.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image", "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image" ], "width":0 }, "has_commerce_goods":true, "hot_sentence_info":"", "id":6872347400942570254, "id_str":"6872347400942570254", "introduction":"", "is_replay":false, "is_show_inquiry_ball":false, "is_show_user_card_switch":true, "last_ping_time":0, "layout":0, "like_count":92949, "linker_map":{ }, "linkmic_layout":1, "live_distribution":[ ], "live_id":1, "live_type_audio":false, "live_type_linkmic":false, "live_type_normal":true, "live_type_official":false, "live_type_sandbox":false, "live_type_screenshot":false, "live_type_third_party":false, "living_room_attrs":{ "admin_flag":0, "rank":0, "room_id":6872347400942570254, "room_id_str":"6872347400942570254", "silence_flag":0 }, "location":"", "lottery_finish_time":0, "luckymoney_num":0, "mosaic_status":0, "mosaic_tip":"", "orientation":0, "os_type":1, "owner":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authentication_info":{ "authentication_badge":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"webcast/authentication_icon.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width":0 }, "custom_verify":"抖音音乐人", "enterprise_verify_reason":"" }, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/3109c00018629796e0bbf", "url_list":[ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/aweme/720x720/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/3109c00018629796e0bbf", "url_list":[ "https://p29-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p1-dy-ipv6.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3109c00018629796e0bbf.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"上海", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"hanyu8866", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":88159, "following_count":272, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":53116625314, "id_str":"53116625314", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600095187, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"君少????", "own_room":{ "room_ids":[ 6872347400942570000 ], "room_ids_str":[ "6872347400942570254" ] }, "pay_grade":{ "grade_banner":"", "grade_describe":"间隔11级还差76抖币", "grade_icon_list":[ ], "level":10, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_10.png", "url_list":[ "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_10.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_10_14.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_10_14.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":234, "screen_chat_type":0, "this_grade_max_diamond":310, "this_grade_min_diamond":230, "total_diamond_count":234, "upgrade_need_consume":0 }, "pay_score":234, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA3MeJAw6E5g0nxsRGlIwlHEVyhjGYcZPQST_y4Zqt9xw", "secret":0, "share_qrcode_uri":"671000112a883c693062", "short_id":379542891, "signature":"????开播工夫：晚21:00～2:00 (偶然提早请谅解下）????直播内容: 唱歌, 风趣, 老歌, 新歌, 心灵, 情感生活..????酷????搜君少 关注下哈, 惟一抖音号其余假冒非自己????身高182:体重135:保持做个好的操行内外兼修的人????小视频全副自己现录现场, 5级粉丝团➕V❤V????", "special_id":"", "status":1, "telephone":"", "ticket_count":52070102, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":true, "with_fusion_shop_entry":true }, "owner_device_id":0, "owner_user_id":53116625314, "popularity":0, "popularity_str":"", "pre_enter_time":0, "preview_copy":" 昨天擦肩而过，明天不再错过~", "preview_flow_tag":0, "private_info":"", "ranklist_audience_type":0, "real_distance":"", "relation_tag":"", "replay":true, "replay_location":0, "room_audit_status":0, "room_auth":{ "AudioChat":0, "Banner":1, "Chat":true, "CommerceCard":1, "Danmaku":false, "DanmakuDefault":1, "Digg":true, "DonationSticker":2, "Gift":true, "GiftAnchorMt":1, "HourRank":0, "Landscape":1, "LandscapeChat":1, "LuckMoney":true, "MoreAnchor":1, "POI":true, "Props":true, "PublicScreen":1, "RecordScreen":2, "RoomContributor":true, "Share":1, "UserCard":true, "UserCorner":1 }, "room_create_ab_param":"", "room_layout":0, "room_tabs":[ ], "room_tag":0, "scroll_config":"", "search_id":0, "sell_goods":false, "share_msg_style":0, "share_url":"https://webcast.amemv.com/webcast/reflow/6872347400942570254", "short_title":"", "short_touch_area_config":{ "elements":{ "1":{ "priority":0, "type":1 }, "2":{ "priority":0, "type":2 }, "3":{ "priority":0, "type":3 }, "4":{ "priority":2, "type":4 }, "5":{ "priority":3, "type":5 }, "6":{ "priority":2, "type":6 }, "7":{ "priority":2, "type":7 }, "8":{ "priority":2, "type":8 }, "9":{ "priority":2, "type":9 }, "10":{ "priority":2, "type":10 }, "12":{ "priority":2, "type":12 } } }, "stamps":"", "start_time":0, "stats":{ "digg_count":0, "dou_plus_promotion":"", "enter_count":0, "fan_ticket":35487, "follow_count":130, "gift_uv_count":114, "id":6872347400942570254, "id_str":"6872347400942570254", "like_count":0, "money":0, "total_user":19291, "total_user_desp":"", "user_count_composition":{ "city":0, "my_follow":0.02, "other":0.54, "video_detail":0.43 }, "watermelon":0 }, "status":2, "stream_close_time":0, "stream_id":107380421578457227, "stream_id_str":"107380421578457227", "stream_provider":0, "stream_url":{ "candidate_resolution":[ ], "complete_push_urls":[ ], "default_resolution":"ORIGION", "extra":{ "anchor_interact_profile":0, "audience_interact_profile":0, "bframe_enable":false, "bitrate_adapt_strategy":0, "bytevc1_enable":false, "default_bitrate":800, "fps":15, "gop_sec":0, "h265_enable":false, "hardware_encode":false, "height":1280, "max_bitrate":1333, "min_bitrate":512, "roi":false, "sw_roi":false, "video_profile":0, "width":720 }, "flv_pull_url":{ }, "flv_pull_url_params":{ }, "hls_pull_url":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8", "hls_pull_url_map":{ }, "hls_pull_url_params":"{"VCodec":"h264"}", "id":107380421578457227, "id_str":"107380421578457227", "live_core_sdk_data":{ "pull_data":{ "options":{ "default_quality":{ "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" }, "qualities":[ { "level":0, "name":"原画", "resolution":"", "sdk_key":"origin", "v_codec":"" } ] }, "stream_data":"{"common":{"session_id":"037-202009142310030100120330321750DAD3"},"data":{"origin":{"main":{"flv":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv","hls":"http://pull-hls-l26.douyincdn.com/stage/stream-107380421578457227_or4.m3u8","cmaf":"","dash":"","sdk_params":"{\"VCodec\":\"h264\",\"gop\":4,\"resolution\":\"or4\",\"vbitrate\":0}"}}}}" } }, "provider":0, "push_urls":[ ], "resolution_name":{ "FULL_HD1":"蓝光", "HD1":"超清", "ORIGION":"原画", "SD1":"标清", "SD2":"高清" }, "rtmp_pull_url":"http://pull-flv-l26.douyincdn.com/stage/stream-107380421578457227_or4.flv", "rtmp_pull_url_params":"{"VCodec":"h264"}", "rtmp_push_url":"", "rtmp_push_url_params":"", "stream_control_type":0 }, "sun_daily_icon_content":"", "tags":[ ], "title":"人帅歌美☘️正能量", "top_fans":[ { "fan_ticket":10400, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/933a3000b63148a7b46ff2933bf6a64b~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"dyru1g558bhr", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":57, "following_count":31, "push_status":0 }, "follow_status":0, "gender":2, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":1103515168282891, "id_str":"1103515168282891", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1599832509, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"雅玉", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔46级还差50.0w抖币", "grade_icon_list":[ ], "level":45, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_45.png", "url_list":[ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_45.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_45_49.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_45_49.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":4000225, "screen_chat_type":0, "this_grade_max_diamond":4500000, "this_grade_min_diamond":3400000, "total_diamond_count":4000225, "upgrade_need_consume":0 }, "pay_score":4000225, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA1iOTCLUnU0ltsnYC-NIh3dIkse2of0cgJxeM9w7P102k8xK4TtEeAvyAnSg6hOys", "secret":1, "share_qrcode_uri":"31166000284aa5924b352", "short_id":3589316171, "signature":"我不能扭转生命的长度，但我能够把握生命的宽度！ 断、舍、离。 断：把不高兴的所有事件从脑海里删除。 舍：把心里面的垃圾定期的解决掉。 离：放过本人放空本人，才会有机会贮存高兴的空间。", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } }, { "fan_ticket":9810, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038", "https://p26-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/ec5f5b94abbf4d0b8b5bab9ccc4ad11c~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_26.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"阜阳", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"2020LZ312", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":25, "following_count":13, "push_status":0 }, "follow_status":0, "gender":1, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":338271925708148, "id_str":"338271925708148", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600016197, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"爱是你我????", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔27级还差1896抖币", "grade_icon_list":[ ], "level":26, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_26.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_26.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_25_29.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_25_29.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_25_29.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":24104, "screen_chat_type":0, "this_grade_max_diamond":26000, "this_grade_min_diamond":20000, "total_diamond_count":24104, "upgrade_need_consume":0 }, "pay_score":24104, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAA-VVOcT--EkEqdZ1ujrsoNOzCqJsr75ldIM1q9I2mN7Q", "secret":0, "share_qrcode_uri":"30f3d00063f1241f256c4", "short_id":3585086691, "signature":"", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } }, { "fan_ticket":4037, "user":{ "adversary_authorization_info":1, "adversary_user_status":0, "allow_be_located":false, "allow_find_by_contacts":false, "allow_others_download_video":false, "allow_others_download_when_sharing_video":false, "allow_share_show_profile":false, "allow_show_in_gossip":false, "allow_show_my_action":false, "allow_strange_comment":false, "allow_unfollower_comment":false, "allow_use_linkmic":false, "authorization_info":3, "avatar_large":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"1080x1080/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p26-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_1080x1080.jpeg?from=4010531038" ], "width":0 }, "avatar_medium":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"720x720/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038", "https://p9-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_720x720.jpeg?from=4010531038" ], "width":0 }, "avatar_thumb":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"100x100/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f", "url_list":[ "https://p9-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038", "https://p29-dy.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038", "https://p3-dy-ipv6.byteimg.com/img/tos-cn-i-0813/43472b54e68f4eb3afc2a2639afe769f~c5_100x100.jpeg?from=4010531038" ], "width":0 }, "badge_image_list":[ { "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_35.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image" ], "width":32 } ], "bg_img_url":"", "birthday":0, "birthday_description":"", "birthday_valid":false, "block_status":0, "city":"深圳", "comment_restrict":0, "commerce_webcast_config_ids":[ ], "constellation":"", "create_time":0, "disable_ichat":0, "display_id":"1904315900lfy", "enable_ichat_img":0, "exp":0, "experience":0, "fan_ticket_count":0, "fans_club":{ "data":{ "anchor_id":0, "available_gift_ids":[ ], "badge":{ "icons":{ "0":{ "avg_color":"", "height":0, "image_type":0, "is_animated":false, "open_web_url":"", "uri":"", "url_list":[ ], "width":0 } }, "title":"" }, "club_name":"", "level":0, "user_fans_club_status":0 }, "prefer_data":{ } }, "fold_stranger_chat":false, "follow_info":{ "follow_status":0, "follower_count":253, "following_count":443, "push_status":0 }, "follow_status":0, "gender":2, "hotsoon_verified":false, "hotsoon_verified_reason":"", "ichat_restrict_type":0, "id":96248386555, "id_str":"96248386555", "income_share_percent":0, "is_follower":false, "is_following":false, "level":0, "link_mic_stats":1, "media_badge_image_list":[ ], "modify_time":1600064506, "need_profile_guide":false, "new_real_time_icons":[ ], "nickname":"ꦿ君❤️兒ℒℴℯ", "pay_grade":{ "grade_banner":"", "grade_describe":"间隔36级还差5.0w抖币", "grade_icon_list":[ ], "level":35, "name":"", "new_im_icon_with_level":{ "avg_color":"", "height":16, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_honor_level_icon_new_35.png", "url_list":[ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_35.png~tplv-obj.image" ], "width":32 }, "new_live_icon":{ "avg_color":"", "height":12, "image_type":1, "is_animated":false, "open_web_url":"", "uri":"webcast/aweme_pay_grade_2x_35_39.png", "url_list":[ "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_35_39.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_35_39.png~tplv-obj.image" ], "width":12 }, "next_diamond":0, "next_name":"", "next_privileges":"", "now_diamond":0, "pay_diamond_bak":0, "score":250001, "screen_chat_type":0, "this_grade_max_diamond":300000, "this_grade_min_diamond":230000, "total_diamond_count":250001, "upgrade_need_consume":0 }, "pay_score":250001, "pay_scores":0, "push_comment_status":false, "push_digg":false, "push_follow":false, "push_friend_action":false, "push_ichat":false, "push_status":false, "push_video_post":false, "push_video_recommend":false, "real_time_icons":[ ], "sec_uid":"MS4wLjABAAAAfNrqgs8FZmDYp6bFp_Ii4SWarXEmTaTohw2OpTwK_5o", "secret":0, "share_qrcode_uri":"2f18e000017540a8d1d9a", "short_id":3481572764, "signature":"陪着你，看着你，想着你，爱着你∽", "special_id":"", "status":1, "telephone":"", "ticket_count":0, "top_fans":[ ], "top_vip_no":0, "total_recharge_diamond_count":0, "user_attr":{ "is_admin":false, "is_muted":false, "is_super_admin":false }, "user_role":0, "verified":true, "verified_content":"", "verified_mobile":false, "verified_reason":"", "with_car_management_permission":false, "with_commerce_permission":false, "with_fusion_shop_entry":false } } ], "use_filter":false, "user_count":1083, "user_share_text":"#在抖音，记录美好生活#【君少????】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "vertical_cover_uri":"", "vid":"", "video_feed_tag":"直播中", "wait_copy":"失去急躁的期待将幸福擦肩而过", "web_count":0, "webcast_comment_tcs":0, "webcast_sdk_version":0, "with_draw_something":false, "with_ktv":false, "with_linkmic":false }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "extra":{ "now":1600096204128 }, "status_code":0 }, "msg":"success"}

November 8, 2020 · 7 min · jiezi

关于大数据:抖音直播监控Api在线观众

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/audience?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": { "currency": "音浪", "has_more": false, "has_once_live": true, "music_wave": "音浪", "ranks": [ { "delta": 0, "first_gift": false, "gap_description": "99", "rank": 1, "score": 99, "user": { "adversary_authorization_info": 0, "adversary_user_status": 0, "allow_be_located": false, "allow_find_by_contacts": false, "allow_others_download_video": false, "allow_others_download_when_sharing_video": false, "allow_share_show_profile": false, "allow_show_in_gossip": false, "allow_show_my_action": false, "allow_strange_comment": false, "allow_unfollower_comment": false, "allow_use_linkmic": false, "authorization_info": 3, "avatar_thumb": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "100x100/316e3000c72bee4420e2d", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/100x100/316e3000c72bee4420e2d.jpeg?from=4010531038" ], "width": 0 }, "badge_image_list": [], "bg_img_url": "", "birthday": 0, "birthday_description": "", "birthday_valid": false, "block_status": 0, "city": "", "comment_restrict": 0, "commerce_webcast_config_ids": [], "constellation": "", "create_time": 0, "disable_ichat": 0, "display_id": "385190430", "enable_ichat_img": 0, "exp": 0, "experience": 0, "fan_ticket_count": 0, "fans_club": { "data": { "anchor_id": 0, "available_gift_ids": [], "badge": { "icons": { "0": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "", "url_list": [], "width": 0 } }, "title": "" }, "club_name": "", "level": 0, "user_fans_club_status": 0 }, "prefer_data": {} }, "fold_stranger_chat": false, "follow_info": { "follow_status": 0, "follower_count": 0, "following_count": 0, "push_status": 0 }, "follow_status": 0, "gender": 0, "hotsoon_verified": false, "hotsoon_verified_reason": "", "ichat_restrict_type": 0, "id": 66287019758, "id_str": "66287019758", "income_share_percent": 0, "is_follower": false, "is_following": false, "level": 0, "link_mic_stats": 0, "media_badge_image_list": [], "modify_time": 0, "need_profile_guide": false, "new_real_time_icons": [], "nickname": "吉森", "pay_grade": { "grade_banner": "", "grade_describe": "间隔17级还差3抖币", "grade_icon_list": [], "level": 16, "name": "", "new_im_icon_with_level": { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_16.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_16.png~tplv-obj.image" ], "width": 32 }, "new_live_icon": { "avg_color": "", "height": 12, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_pay_grade_2x_15_19.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_15_19.png~tplv-obj.image" ], "width": 12 }, "next_diamond": 0, "next_name": "", "next_privileges": "", "now_diamond": 0, "pay_diamond_bak": 0, "score": 1697, "screen_chat_type": 0, "this_grade_max_diamond": 1700, "this_grade_min_diamond": 1300, "total_diamond_count": 1697, "upgrade_need_consume": 0 }, "pay_score": 0, "pay_scores": 0, "push_comment_status": false, "push_digg": false, "push_follow": false, "push_friend_action": false, "push_ichat": false, "push_status": false, "push_video_post": false, "push_video_recommend": false, "real_time_icons": [], "sec_uid": "MS4wLjABAAAABkK4jcEax0iVyUVnrSH3Q63wM6vRb_OlpK0Zd9DbcwE", "secret": 0, "share_qrcode_uri": "", "short_id": 385190430, "signature": "", "special_id": "", "status": 0, "telephone": "", "ticket_count": 0, "top_fans": [], "top_vip_no": 0, "total_recharge_diamond_count": 0, "user_role": 0, "verified": false, "verified_content": "", "verified_mobile": false, "verified_reason": "", "with_car_management_permission": false, "with_commerce_permission": false, "with_fusion_shop_entry": false } }, ], "rules_url": "sslocal://webcast_webview?url=https%3A%2F%2Faweme.snssdk.com%2Fmagic%2Fpage%2Fejs%2F5f27c6ca9950ec0307de9248%3FappType%3Ddouyin%26pull_down_indicator_color%3Ddark%26pull_down_indicator_not_show%3D0%26web_bg_color%3D%2523ffffffff&pull_down_close=0&pull_down_indicator_not_show=1&pull_down_indicator_color=dark&type=popup&gravity=bottom&height=450&radius=8&hide_more=0&hide_nav_bar=0&hide_status_bar=0&landscape_custom_width=1&rate_height=450", "seats": [], "self_info": { "delta": 0, "first_gift": false, "gap_description": "本场奉献：0音浪", "rank": 0, "score": 0 }, "total": 0 }, "extra": { "now": 1600957337628 }, "status_code": 0 }, "msg": "success"}

November 7, 2020 · 2 min · jiezi

关于大数据:大数据复习资源管理YARN

MRv1角色JobTracker 外围，主，单点调度所有作业监控整个集群的资源负载TaskTracker 从，本身节点资源管理和JobTracker心跳，汇报资源，被动获取TaskClient 作业为单位布局作业计算散布提交作业资源到HDFS最终作业提交到JobTracker弊病JobTracker：负载过重，单点故障资源管理与计算调度强耦合，其余计算框架须要反复实现资源管理不同框架对资源不能全局治理YARN 客户端client将工作提交给ResourceManager（资源的齐全掌控者，长服务）ResourceManager找一台资源闲暇的服务器启动一个过程：ApplicationMaster（任务调度者，短服务）ApplicationMaster不理解集群资源，须要向ResourceManager申请工作资源ApplicationMaster找到对应节点启动创立容器ContainerNodeManager（长服务）向ResourceManager汇报Container信息和节点资源状况MRv2 On YarnYarn：解耦资源与计算 ResourceManager 主，外围集群节点资源管理NodeManager 与ResourceManager汇报资源治理Container生命周期MR MR-ApplicationMaster-Container 作业为单位，调配到不同节点，防止单点故障创立Task须要向ResourceManager申请资源Task-ContainerYARN : Yet Another Resource Negotiater核心思想：将JobTracker和资源管理和任务调度两个性能离开。别离由ResourceManager和ApplicationMaster过程实现。ResourceManager：负责整个集群的资源管理ApplicationMaster：负责应用程序的任务调度，工作监控YARN的引入，使得多个计算框架可运行在一个集群中 MapReduce,Spark,Strom每个应用程序对应一个ApplicationMaster

November 6, 2020 · 1 min · jiezi

关于大数据:抖音直播监控Api开播查询

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/status?token=xxx&room_id=6843198199583378191,6872323400263797518申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": [ { "alive": false, "room_id": 6843198199583378191 }, { "alive": true, "room_id": 6872323400263797518 } ], "extra": { "now": 1600096174925 }, "status_code": 0 }, "msg": "success"}

November 6, 2020 · 1 min · jiezi

关于大数据:大数据复习MapReduce

MR原语：map + reduce map数量由什么确定？ map --- split 与split片数量一一对应block块是真正被切割开的物理块，split片是在block块根底上再切割的逻辑片，由block块决定一个job作业中map数量与split片数量无关map 拿到数据后进行两头集映射(K，V)，同时生成分区partition编号reduce数量由什么决定？ 惯例：一个 K 对应一个 reduce也能够把多个 K 对应到一个 reduce，然而不能把一个 K 对应多个 reduce（雷同的 K 必须交给同一个 reduce） 先获取split片，交给map（默认split片大小 == block块大小，128M）map映射成（K,V）两头集后，先将数据写入内存缓冲区buffer in memory 一次排序：在缓冲区中依照分区partition（有几个reduce就有几个分区partition）进行排序，雷同分区的数据放在一起二次排序：分区内依照K 进行排序，雷同的K 放到一起（一个reduce可能对应多个K）数据压缩combiner ：在map端进行一次迭代计算后再发送给reduce 缩小reduce计算量内存缓冲区写满后，先译写成小文件存到磁盘，当map数据处理完之后会造成一堆小文件， 三次排序：泛滥小文件还要进行排序，并合并成大文件四次排序：泛滥map产生的大文件再进行排序，合并成更大的文件最初合并成的更大的文件交给reduce解决

November 5, 2020 · 1 min · jiezi

关于大数据:抖音直播监控Api直播间带货商品列表

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/promotions?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code":200, "data":{ "current_promotion_id":"3436129527946972390", "entries":[ { "icon":"http://p3.pstatp.com/origin/321f50008dae87efe41ce", "title":"订单", "type":2, "url":"aweme://webview/?url=https%3A%2F%2Faweme.snssdk.com%2Ffalcon%2Fe_commerce%2Frn%2Forder_dashboard%2F%3Fstatus_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26enter_from%3Dlive_list_card%26origin_type%3D9902106000&status_font_dark=0&hide_nav_bar=1&loading_bgcolor=161823&should_full_screen=1&enter_from=live_list_card&origin_type=9902106000&rn_schema=aweme%3A%2F%2Freactnative%2F%3Fmodule_name%3Dpage_order_dashboard%26status_font_dark%3D0%26hide_nav_bar%3D1%26loading_bgcolor%3D161823%26should_full_screen%3D1%26channel%3Dfe_lyon_order_dashboard%26bundle%3Dindex.js%26enter_from%3Dlive_list_card%26origin_type%3D9902106000" } ], "expire_time":300000, "flash_total":0, "has_more":false, "min_refresh_gap":10000, "next_page_id":"", "promotions":[ Object{...}, { "app_type":0, "app_url":"", "apply_coupon":0, "button_label":"去购买", "campaign":false, "can_explain":true, "can_seckill":false, "cos_fee":0, "cos_ratio":0, "coupons":[ ], "cover":"https://sf6-ttcdn-tos.pstatp.com/img/temai/4d79a9bc80b64c9ffd9412fc45f59c9bwww850-850~tplv-resize:200:0.webp", "detail_url":"aweme://goods/seeding/?promotion_id=3436129527946972390&product_id=3436129527946972390&target_uid=3773170526723102&item_id=0&source_page=live&sec_target_uid=MS4wLjABAAAAtvPLMdtyUwsz7C5mYnFRnpVzkJTC4k_AGxjfPhzu8dWQymu9_lzXPHMXp1q5gnGj&meta_param={"enter_from":"live","live_room_id":"6872323400263797518"}&carrier_type=&entrance_info=", "elastic_title":"", "event_param":{ }, "extra":{ "coupon_min_price":"0", "start_time":"0" }, "flash_icon":"", "flash_type":0, "in_stock":true, "index":2, "item_type":6, "label_icon":"https://sf1-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/explain_new.png", "min_price":5990, "next_page":"split", "order_url":"", "platform":4, "platform_icon":"https://sf6-ttcdn-tos.pstatp.com/obj/cmp-ecom-alliance/platform_xiaodian.png", "platform_label":"小店", "price":99900, "product_id":"3436129527946972390", "promotion_id":"3436129527946972390", "promotion_source":[ ], "sale_num":0, "shop_id":3494225, "short_half_url":"", "short_title":"", "skip_style":0, "status":2, "stock_num":0, "title":"k00006三色显瘦牛仔裤" }, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...}, Object{...} ], "room_type":0, "show_begin_time":0, "show_duration":0, "status_code":0, "status_msg":"", "top_limit":100, "total":31 }, "msg":"success"}

November 5, 2020 · 1 min · jiezi

关于大数据:实时数据融合之道博观约取价值驱动

陈雷 | DataPipeline 合伙人 & CPO曾任 IBM 大中华区认知物联网实验室服务部首席数据科学家、资深参谋经理。十年治理教训，十五年数据迷信畛域与金融畛域教训。综合交通大数据利用技术国家工程实验室产业翻新部主任，西安交通大学软件学院大数据智能翻新核心主任，中国电子学会区块链专委会委员。 所谓数据时效性的晋升指的绝不仅仅是用户行为数据、交易数据等时序数据的时效性，或者说这些数据的时效性自身都是很高的，数据时效性晋升的次要战场应该是针对散落在各业务零碎中没有被集中管理的各类结构化数据以及须要汇聚关联各个业务数据后加工计算的数据（说人话：没有纳入主数据系统治理的各业务零碎账户、客户数据及数据仓库、集市中的剖析加工后果数据的时效性个别都比拟低）。 近年来随着互联网企业在数据技术倒退过程中逐步占据主导地位，互联网数据、用户行为数据等大数据概念被大家广泛承受，但对于企业来说与其把眼光盯在价值密度较低的沙子上筛来筛去，不如好好想想本人家里的金山钻石矿里的数据能不能更快地变现（说人话：客户在网银上的拜访轨迹的价值远不如客户账户大额变动来的有价值，所以先想方法把这事通知客户经理吧）。 当然并不是说内部数据没价值或者说时效性不重要，而是说要全面思考企业域、产业域、生态域可利用的数据，基于理论价值驱动，由高到低晋升数据时效性，而不是依照数据自身的时效性来加以利用，本末倒置，遗记了数据时效性晋升的基本目标是为了业务价值（说人话：业务零碎里的数据实时获取是比互联网数据获取艰难，面临的问题多，可是价值也高呀，你得挑值钱的活干，不能挑好干的活干呀）。 当然，价值在不同档次和不同维度上的了解和定位是不一样的，但在实时数据价值开释过程中，大家须要留神，尽管管理层须要实时理解经营治理信息，但这意味着各业务部门须要扭转流程甚至结算的体系。这所面临的艰难远不止于技术层面。只管能够失去自上而下的强力推动，但具体工作却始于一线。在企业层面没有对实时数据的利用达成根本共识之前，实时数据在经营治理类场景中的利用尤为谨慎，不要让本人陷入到对于数据口径、数据品质、数据准确性的权责陷阱中，实时数据更好的切入点是间接与支出相干的触客业务，无论是基于账户变动的事件营销抑或是帮助客户经理的实时画像，这也很迷信，管理层要的是指挥若定，失之毫厘谬以千里，一线要的是炮弹，销售线索原本就是用来验证的（说人话：你会发现客户和基层营销人员对帮忙他们的工具的容忍度要远远高于你的领导）。 综上，实时数据既要全面笼罩能被利用的各类数据，也要基于价值分清先后顺序；既要高效开释数据价值，也要选好抓手、切入点；所谓博观约取，价值驱动。——的确能够，不过领导，咱们这个可是触客业务，这么做稳吗？——稳不稳的咱们往下看。 咱们将在下一期的“实时数据交融之法：稳固高容错”中具体阐释实时数据交融如何做能力应答各种不稳固带来的不确定性，敬请期待！

November 4, 2020 · 1 min · jiezi

关于大数据:数据系统架构3数据仓库设计

3.数据仓库设计序数据仓库是为了让人人都能够低成本的应用数据，依照肯定规范打造的全量数据资料的汇合。 指标 数据仓库设计的指标，就是把过来曾经产生的非结构化的日志数据转成结构化的数据与后端关系型的数据库里的数据资源进行无效的整合和存储；数据依照特定的逻辑生成不同层级的数据表，以供业务剖析人员低成本的应用数据；良好的数仓设计能够保障逻辑的复用、节约计算资源、保证数据品质，升高数据分析老本，进步数据应用效率与价值。开发准则防止烟囱式数据开发，优先依据主题域设计对应的数据仓库表统计数据严禁从底层数据表间接统计对立库、表、SQL标准数仓地图、逻辑文档的积淀与推广，造成共识数仓设计数据仓库与传统的关系型数据库，因为利用场景与实现技术的差别，数据仓库在设计的时候大多数都是违反关系型数据库三范式进行设计的开发的。 分层 ODS：数据起源层，次要蕴含业务数据库快照数据（rawdb）、埋点数据(rawdata)、其余业务等数据。 TMP：长期层，数据处理的辅助解决层，服务于DW、DM层，次要是一些两头后果长期存储的数据,包含：计算工作的两头后果数据、ODS层轻度综合和汇总统计的数据等，定期清理。 DIM：维度数据层，次要蕴含一些字典表、维度数据。实例：品类字典表、城市字典表、终端类型表 DW：data warehouse，存储通过规范规范化解决（即数据荡涤）后的经营数据，是根底事实数据明细层。实例：后端日志明细表、前端埋点日志明细表、mysql各业务数据通过ETL解决后的表。 DM：data market(也叫DWS：data warehouse service)，数据主题层或者宽表层，按部门按专题进行划分，反对OLAP剖析、数据散发等，其信息次要来源于DW 或TMP层汇总数据。实例：新激活用户业务剖析表、日活用户业务剖析表、历史激活用户业务剖析表、用户行为轨迹表、红包业务表、交易品类起源多维表、商业广告多维分析报表 ADS：application database service,利用数据层, 面向具体利用的表，要创立在这层，可导入hbase或mysql等应用。实例：按天、小时、5分钟粒度计算汇总的后果存入mysql、hbase的报表 模型星型模型：外围是一个事实表及多个非正规化形容的维度表组成。雪花模型：是星型模型的扩大，不同的是维度表被规范化，进一步合成到附加表中大星座模型：由多个事实表组合，维表是公共的，能够被多个事实表共享。星座模型是数据仓库最常应用的模型。数据仓库标准库标准数据库命名（集群名_公司名_数据分层_部门） 表标准ODS： raw_业务数据库表名(保持一致)_更新形式(如果增量同步加“_inc”,全量“_full”)_工夫粒度log_前端/后端日志_更新形式(如果增量同步加“_inc”,全量“_full”)_工夫粒度TMP： tmp_数据层类型(dw|dm)_{业务过程形容}DIM： dim_维度类型（cate|city|channel|group）DW： 日志：dw_log_{业务主题域}_{业务过程形容}_更新形式_工夫粒度业务数据库：dw_数据库类型（mysql|hbase|wtable|redis）_{业务主题域}_{业务过程形容}_更新形式_工夫粒度多数据源：dw_{业务主题域}_{业务过程形容}_更新形式_工夫粒度DM： dm_{数据主题域}_{业务过程形容}_更新形式_工夫粒度ADS： ads_{业务过程形容}_更新形式_工夫粒度数据主题域 交易：trade支出：income推送：push流量：traffic营销：market服务：service商业广告：biz渠道：channel地址：address财务：finance风控：spam竞品：compete……更新形式命名标准： 增量：inc全量：full……分区表表名工夫粒度命名标准： 小时(hour)：1h天(day)：1d周(week)：1w月(month)：1m季度(quarter)：1q年(year)：1y ......分区字段: 日期分区对立命名为：dt，格局：yyyy-MM-dd or yyyy-MM or yyyy非分区表表名工夫粒度前面加：对立为”_0p”字段字段命名标准：seller_id、buyer_id、first_from、order_source、xxx_date、xxx_time 日期字段：<业务主体>_date工夫字段：<业务主体>_time属性字段：属性本身英文单词;如:statusid 字段：<标识主体>_id;标识字段：is_<标识主体>;如:is_true指标字段：工夫周期+修饰词+原子指标计次字段：<计数主体>_pv;如:visit_pv排重计数字段：<计数主体>_uv;如:visit_uv价格字段：<业务主体>_price;如:pay_price起源字段：<业务主体>_source;如:order_source比例字段：<业务主体>_rate;如:gmv_yoy_rate元数据管理1.形容哪些数据在数据仓库中;2.定义要进入数据仓库中的数据和从数据仓库中产生的数据;3.记录依据业务事件产生而随之进行的数据抽取工作工夫安顿;4.记录并检测零碎数据一致性的要求和执行状况;5.掂量数据品质。 脉络地图 在收集整理了各种日志、业务零碎数据之后，咱们创立了本人的数据仓库，依据数据仓库的元信息等等，咱们应该生成一个数据仓库外围脉络地图，以供其余人员荡涤明了的把握数据仓库的外围表逻辑与构造。当开发一个数据统计需要时，咱们能够疾速的定位到本人所需应用的表并清晰明了表中数据的逻辑，做到表可用、表敢用、大大降低数据仓库应用沟通老本。 实时数仓随着技术的倒退，大数据处理一直的朝着SQL化，批流合一的方向倒退。咱们解决数据的速度越来越快，与之对应的就是咱们能够带来更快的数据产出，投入到对应的剖析场景当中，晋升数据时效性充沛挖掘数据价值。实时数仓能够为咱们带来以下几个有点： 整体晋升数据时效性与价值接入各类实时剖析查问引擎提供实时剖析能力，比方 druid正当平滑的利用计算资源，无需在凌晨大量离线工作启动，造成资源应用顶峰、工作沉积期待。

November 4, 2020 · 1 min · jiezi

关于大数据:大数据工程师专项认证来了从入门到精通获得求职敲门砖

随着挪动网络、云计算、物联网等新兴技术迅猛发展，寰球数据呈爆炸式增长，影响深远的大数据时代未然开启大幕，在人不知;鬼不觉中扭转着人们的生存和思维形式，然而大数据人才在世界范畴内仍处于紧缺状态。目前各类统计报告中，对于将来国内大数据人才缺口数字预估将达上千万。 为了更加高效地造就大数据业余技术人才，同时也帮忙个人用户晋升大数据技术竞争力。京东智联云培训与认证推出了【京东智联云大数据工程师认证】。 认证介绍 京东智联云大数据工程师认证 是大数据行业认证体系中的技能认证，面向应用京东智联云大数据产品的业余技术认证。次要波及京东智联云的大数据计算、存储、开发平台，数据利用类的产品，是对学员把握京东智联云大数据产品技术技能程度的全面测验和能力认证。 京东智联云大数据工程师课程将通过实践精讲与上机试验相结合的形式，系统性地介绍大数据技术的生态环境，以及如何基于京东智联云产品在京东云平台上开明、部署和应用大数据开发。 认证证书 实现学习课程并通过认证考试即可取得京东智联云官网权威认证证书，为您的技术实力提供强有力的证实。您的业余认证信息将被纳入京东智联云云计算技术能力认证库，反对查问认证信息。同时京东智联云人才库也将同步您的信息，为您的职业倒退护航，开拓招聘绿色通道，提供更多职场机会。 为了帮忙想学习云计算相干产品及实操的小伙伴晋升常识储备、锻炼业余技术、进步待业竞争力，去年年底咱们推出了 【京东智联云培训&认证】课程，针对从业人员或心愿进入云行业人员的专业性技能进行培训与认证。 目前咱们领有两项助理工程师认证和一个专项工程师认证。京东智联云云计算助理工程师认证（JCA）及 京东智联云云运维助理工程师认证（JCA）为京东智联云云根底产品用户和运维人员提供业余技术认证。该项认证内容包含京东智联云的计算服务、网络服务、存储服务及平安等方面的外围产品，是对从业人员或心愿进入云行业人员的专业性技能认证。 京东智联云专有云工程师认证（JCS）针对专有云平台京东智联云产品施行人员及运维人员提供的业余技术认证。该项认证内容包含京东智联云专有云交付，治理和运维等方面的内容，帮助学习者学习基于专有云平台京东智联云产品的交付部署能力和产品运维能力。课程内容包含JD Cloud Stack, Swift, Mesh的全面产品介绍及解决方案。通过认证，可帮忙学习者晋升对专有云的了解，能够对京东智联云根底产品进行交付部署和运维工作，保障企业及集体云上业务的失常稳固运行。 福利来啦！ 上面为大家带来一个好消息 11.11 大促期间，京东智联云培训与认证全线半价 JCA 工程师认证、JCS专有云、大数据工程师认证 通通半价支付！ 拼手速的时候到了，小伙伴们冲鸭！ 举荐浏览： 赋能开发者 | 京东智联云培训与认证课程人才培养再次降级京东智联云开发者2020“校园技术星”KOC招募进行中欢送点击【京东智联云】，理解开发者社区 更多精彩技术实际与独家干货解析 欢送关注【京东智联云开发者】公众号

November 4, 2020 · 1 min · jiezi

关于大数据:抖音直播监控Api弹幕关注送礼点赞来了-实时获取

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/chat?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": [ { "type": "WebcastSocialMessage", "nickname": "薛莲", "uid": "111265487875", "short_id": "2072651305", "msg_id": "6843261579299965709", "sec_uid": "\"MS4wLjABAAAAmpM-hJ8AeUM8hSc3w5YlY8Q2ZUaiEu7uvt6cApLkyjg\"", "msg": "关注了主播" }, { "type": "WebcastMemberMessage", "nickname": "用户5121651744892", "uid": "3654415794833197", "short_id": "2980367364", "msg_id": "6843261580051155719", "sec_uid": "\"MS4wLjABAAAAYcAoC-U8hSeyUxnGx_i5yoHRPPfwtr2wfplWg9KGsSMXyi7pWlPMV6XwMX7xpDgK\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "大姑", "uid": "3091436132641739", "short_id": "2372670321", "msg_id": "6843261580789320462", "sec_uid": "\"MS4wLjABAAAAws0M9rKV7kK1ayWZ31Ebjsd8SwFI0rdf8goPY7HI8tELNK1XkFpX25yvHqe8WY9d\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "我有一个好名字", "uid": "98675983627", "short_id": "1144452894", "msg_id": "6843261580508433159", "sec_uid": "\"MS4wLjABAAAAQhMqocOlzOLFvUE0tJKLQWKx1QuP8YXQmI2A6L3kWLQ\"", "msg": "来了" }, { "type": "WebcastMemberMessage", "nickname": "李祥林", "uid": "2946292105354829", "short_id": "3496282621", "msg_id": "6843261585180560136", "sec_uid": "\"MS4wLjABAAAAcFKemBUvCP-CppApJZsS_4FEuIAWf2_2fpyrcsrs1PZi4U0PyXOK-3qRy4dVnAWW\"", "msg": "来了" }, { "type": "WebcastChatMessage", "uid": "4006248980690445", "tid": "6843260054435826435", "nickname": "幸福", "text": "我不会买", "sec_uid": "MS4wLjABAAAAZWY-mQkfFitGRzNztj2FwNI6EJL6VJhEwuy3ehDmsVNBst1E2dU4umtJKmX4VW5S", "avatar": "https://p9-dy.byteimg.com/aweme/100x100/2dbd70006de205b08161b.jpeg?from=4010531038" }, { "type": "WebcastMemberMessage", "nickname": "双子座一半天使，一半恶魔的陈欣彤????????", "uid": "945180703722141", "short_id": "2789104616", "msg_id": "6843261584941288205", "sec_uid": "\"MS4wLjABAAAAwvMatTP6mPsnysD0IPVmALci4CsfvRgOUi7lJxzq-c8\"", "msg": "来了" } ], "msg": 'success'}

November 4, 2020 · 1 min · jiezi

关于大数据:大数据复习HDFS

存储模型：字节文件依照字节切割成块（block）默认128MB，最小1M（可批改），每个 block 块有偏移量 offset，block块扩散存储在集群结点中。横向扩大同一文件的block块大小雷同，不同文件的block块大小能够不同。block块能够设置正本，默认三个正本（可批改）。纵向扩大 正本搁置策略： 第一个正本：放在上传文件的DataNode第二个正本：放在与第一个正本不同的机架的节点上第三个正本：放在与第二个正本雷同机架的其余节点上更多正本：随机节点只反对一次写入屡次读取，不可批改块内容，能够append追加数据，同一时刻只有一个写入者架构模型1.x：主从 NameNode（主结点）：管理文件的元数据信息（MetaData）：block块大小，offset偏移量等等接管客户端的读写服务基于内存存储（不会和磁盘产生替换）收级DataNode汇报的block列表DataNode（从结点）：负责保护治理放在本节点的block块的元数据信息（MD5：保障数据完整性）与NameNode放弃心跳，并向NameNode汇报block块信息NameNode长久化：fsimage（时点备份）：metadata存储到磁盘文件的名字EditsLog：记录对metedata的操作fsimage和editsLog 在达到肯定条件（check point）会进行合并，造成一个新的fsimageSecondaryNameNode（SNN）它不是NameNode的备份（然而能够做备份）它的次要工作是帮忙NN合并editsLog和fsimageSNN合并流程 HDFS长处：高容错性 数据主动保留多个正本正本失落后主动复原（从良好节点上拷贝）适宜批处理 计算向数据挪动数据地位（offset）裸露给计算框架适宜大数据处理 GB、TB、PB、百万规模文件可构建在便宜机器上HDFS写流程： HDFS读流程： Hadoop2.x产生背景Hadoop1.x中HDFS和MapReduce存在高可用、扩展性的问题HDFS问题 NameNode单点故障。通过主备NameNode解决（HA）NameNode压力过大，联邦Federation 架构模型2.xHadoop 2.x 由HDFS，MapReduce和Yarn三个分支组成 HDFS 2.x:只反对2个节点HA ，3.x反对一主多备

November 3, 2020 · 1 min · jiezi

关于大数据:抖音直播监控Api直播间信息

TiToData：业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博申请Apihttp://主机地址/douyin/liveroom/info?token=xxx&room_id=6843198199583378191申请形式GET参数字段类型阐明tokenstring接口受权码room_idint直播间id返回示例{ "code": 200, "data": { "data": { "AnchorABMap": { }, "admin_user_ids": [ ], "anchor_scheduled_time_text": "", "anchor_share_text": "#在抖音，记录美好生活#【小鱼家服饰1店】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "anchor_tab_type": 0, "app_id": 0, "auto_cover": 0, "base_category": 0, "book_end_time": 0, "book_time": 0, "business_live": 1, "category": 0, "cell_style": 3, "challenge_info": "", "client_version": 110500, "comment_box": { "placeholder": "说点什么..." }, "comment_name_mode": 0, "common_label_list": "", "content_tag": "", "cover": { "avg_color": "#EBE1CE", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/6819084786280876808", "url_list": [ "http://p9-webcast-dycdn.byteimg.com/img/webcast/6819084786280876808~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/6819084786280876808~tplv-obj.image" ], "width": 0 }, "create_time": 1593306241, "deco_list": [ ], "distance": "", "distance_city": "", "distance_km": "", "dynamic_cover_dict": { }, "dynamic_cover_uri": "", "enable_room_perspective": false, "fansclub_msg_style": 2, "fcdn_appid": 0, "feed_room_label": { "avg_color": "#A3967C", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/2ea90002aca1159b5c67", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/2ea90002aca1159b5c67~tplv-obj.image" ], "width": 0 }, "finish_reason": 0, "finish_time": 1593362656, "finish_url": "", "follow_msg_style": 2, "forum_extra_data": "", "gift_msg_style": 2, "group_id": 0, "group_source": 0, "guide_button": { "avg_color": "#7A5353", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_button_togather_3x.png", "url_list": [ "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/aweme_button_togather_3x.png~tplv-obj.image" ], "width": 0 }, "has_commerce_goods": true, "hot_sentence_info": "", "id": 6843198199583378191, "id_str": "6843198199583378191", "introduction": "", "is_replay": false, "is_show_inquiry_ball": false, "is_show_user_card_switch": true, "last_ping_time": 0, "layout": 0, "like_count": 4746, "linker_map": { }, "linkmic_layout": 1, "live_distribution": [ ], "live_id": 1, "live_type_audio": false, "live_type_linkmic": false, "live_type_normal": true, "live_type_official": false, "live_type_sandbox": false, "live_type_screenshot": false, "live_type_third_party": false, "living_room_attrs": { "admin_flag": 0, "rank": 0, "room_id": 6843198199583378191, "room_id_str": "6843198199583378191", "silence_flag": 0 }, "location": "", "lottery_finish_time": 0, "luckymoney_num": 0, "mosaic_status": 0, "mosaic_tip": "", "orientation": 0, "os_type": 1, "owner": { "adversary_authorization_info": 1, "adversary_user_status": 0, "allow_be_located": false, "allow_find_by_contacts": false, "allow_others_download_video": false, "allow_others_download_when_sharing_video": false, "allow_share_show_profile": false, "allow_show_in_gossip": false, "allow_show_my_action": false, "allow_strange_comment": false, "allow_unfollower_comment": false, "allow_use_linkmic": false, "authentication_info": { "authentication_badge": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "webcast/authentication_icon.png", "url_list": [ "http://p3-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image", "http://p9-webcast-dycdn.byteimg.com/img/webcast/authentication_icon.png~tplv-obj.image" ], "width": 0 }, "custom_verify": "", "enterprise_verify_reason": "六安裕安星期八服装经营部" }, "authorization_info": 3, "avatar_large": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "1080x1080/3110f00056c0567624bbb", "url_list": [ "https://p3-dy-ipv6.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p29-dy.byteimg.com/aweme/1080x1080/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "avatar_medium": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "720x720/3110f00056c0567624bbb", "url_list": [ "https://p29-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p26-dy.byteimg.com/aweme/720x720/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "avatar_thumb": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "100x100/3110f00056c0567624bbb", "url_list": [ "https://p29-dy.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p6-dy-ipv6.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038", "https://p9-dy.byteimg.com/aweme/100x100/3110f00056c0567624bbb.jpeg?from=4010531038" ], "width": 0 }, "badge_image_list": [ { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_5.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image" ], "width": 32 } ], "bg_img_url": "", "birthday": 0, "birthday_description": "", "birthday_valid": false, "block_status": 0, "city": "", "comment_restrict": 0, "commerce_webcast_config_ids": [ ], "constellation": "", "create_time": 0, "disable_ichat": 0, "display_id": "xiaoyu58888", "enable_ichat_img": 0, "exp": 0, "experience": 0, "fan_ticket_count": 0, "fans_club": { "data": { "anchor_id": 0, "available_gift_ids": [ ], "badge": { "icons": { "0": { "avg_color": "", "height": 0, "image_type": 0, "is_animated": false, "open_web_url": "", "uri": "", "url_list": [ ], "width": 0 } }, "title": "" }, "club_name": "", "level": 0, "user_fans_club_status": 0 }, "prefer_data": { } }, "fold_stranger_chat": false, "follow_info": { "follow_status": 0, "follower_count": 214171, "following_count": 7, "push_status": 0 }, "follow_status": 0, "gender": 2, "hotsoon_verified": false, "hotsoon_verified_reason": "", "ichat_restrict_type": 0, "id": 95760275230, "id_str": "95760275230", "income_share_percent": 0, "is_follower": false, "is_following": false, "level": 0, "link_mic_stats": 1, "media_badge_image_list": [ ], "modify_time": 1600068668, "need_profile_guide": false, "new_real_time_icons": [ ], "nickname": "小鱼家服饰1店", "pay_grade": { "grade_banner": "", "grade_describe": "间隔6级还差17抖币", "grade_icon_list": [ ], "level": 5, "name": "", "new_im_icon_with_level": { "avg_color": "", "height": 16, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_honor_level_icon_new_5.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image", "http://p1-webcast-dycdn.byteimg.com/img/webcast/aweme_honor_level_icon_new_5.png~tplv-obj.image" ], "width": 32 }, "new_live_icon": { "avg_color": "", "height": 12, "image_type": 1, "is_animated": false, "open_web_url": "", "uri": "webcast/aweme_pay_grade_2x_5_9.png", "url_list": [ "http://p6-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_5_9.png~tplv-obj.image", "http://p3-webcast-dycdn.byteimg.com/img/webcast/aweme_pay_grade_2x_5_9.png~tplv-obj.image" ], "width": 12 }, "next_diamond": 0, "next_name": "", "next_privileges": "", "now_diamond": 0, "pay_diamond_bak": 0, "score": 48, "screen_chat_type": 0, "this_grade_max_diamond": 65, "this_grade_min_diamond": 45, "total_diamond_count": 48, "upgrade_need_consume": 0 }, "pay_score": 48, "pay_scores": 0, "push_comment_status": false, "push_digg": false, "push_follow": false, "push_friend_action": false, "push_ichat": false, "push_status": false, "push_video_post": false, "push_video_recommend": false, "real_time_icons": [ ], "sec_uid": "MS4wLjABAAAAKp0OuO92yhbvfneuhthk-gskWF0f_JD1W3LRVltoEkc", "secret": 0, "share_qrcode_uri": "7b85001cb87e09f40e06", "short_id": 830360786, "signature": "卖衣服的小鱼儿", "special_id": "", "status": 1, "telephone": "", "ticket_count": 1890, "top_fans": [ ], "top_vip_no": 0, "total_recharge_diamond_count": 0, "user_attr": { "is_admin": false, "is_muted": false, "is_super_admin": false }, "user_role": 0, "verified": true, "verified_content": "", "verified_mobile": false, "verified_reason": "", "with_car_management_permission": false, "with_commerce_permission": true, "with_fusion_shop_entry": true }, "owner_device_id": 0, "owner_user_id": 95760275230, "popularity": 0, "popularity_str": "", "pre_enter_time": 0, "preview_copy": "世界很大，但咱们很有缘~", "preview_flow_tag": 0, "private_info": "", "ranklist_audience_type": 0, "real_distance": "", "relation_tag": "", "replay": false, "replay_location": 0, "room_audit_status": 0, "room_auth": { "AudioChat": 2, "Banner": 1, "Chat": true, "CommerceCard": 1, "Danmaku": false, "DanmakuDefault": 0, "Digg": true, "DonationSticker": 2, "Gift": true, "GiftAnchorMt": 0, "HourRank": 0, "Landscape": 1, "LandscapeChat": 1, "LuckMoney": true, "MoreAnchor": 1, "POI": true, "Props": true, "PublicScreen": 1, "RecordScreen": 0, "RoomContributor": true, "Share": 1, "UserCard": true, "UserCorner": 1 }, "room_create_ab_param": "", "room_layout": 0, "room_tabs": [ ], "room_tag": 0, "scroll_config": "", "search_id": 0, "sell_goods": false, "share_msg_style": 2, "share_url": "https://webcast.amemv.com/webcast/reflow/6843198199583378191", "short_title": "", "short_touch_area_config": { "elements": { "1": { "priority": 0, "type": 1 }, "2": { "priority": 0, "type": 2 }, "3": { "priority": 0, "type": 3 }, "4": { "priority": 2, "type": 4 }, "5": { "priority": 3, "type": 5 }, "6": { "priority": 2, "type": 6 }, "7": { "priority": 2, "type": 7 }, "8": { "priority": 2, "type": 8 }, "9": { "priority": 2, "type": 9 }, "10": { "priority": 2, "type": 10 }, "12": { "priority": 2, "type": 12 } } }, "stamps": "", "start_time": 1593306245, "stats": { "digg_count": 0, "dou_plus_promotion": "", "enter_count": 0, "fan_ticket": 0, "follow_count": 2612, "gift_uv_count": 26, "id": 6843198199583378191, "id_str": "6843198199583378191", "like_count": 0, "money": 0, "total_user": 164069, "total_user_desp": "", "user_count_composition": { "city": 0, "my_follow": 0.02, "other": 0.27, "video_detail": 0.71 }, "watermelon": 0 }, "status": 4, "stream_close_time": 0, "stream_id": 683385719577641061, "stream_id_str": "683385719577641061", "stream_provider": 0, "stream_url": { "candidate_resolution": [ ], "complete_push_urls": [ ], "default_resolution": "ORIGION", "extra": { "anchor_interact_profile": 0, "audience_interact_profile": 0, "bframe_enable": false, "bitrate_adapt_strategy": 0, "bytevc1_enable": false, "default_bitrate": 800, "fps": 15, "gop_sec": 0, "h265_enable": false, "hardware_encode": false, "height": 640, "max_bitrate": 1333, "min_bitrate": 512, "roi": false, "sw_roi": false, "video_profile": 0, "width": 368 }, "flv_pull_url": { }, "flv_pull_url_params": { }, "hls_pull_url": "http://pull-hls-f11.douyincdn.com/stage/stream-683385719577641061.m3u8", "hls_pull_url_map": { }, "hls_pull_url_params": "{\"VCodec\":\"h264\"}", "id": 683385719577641061, "id_str": "683385719577641061", "live_core_sdk_data": { "pull_data": { "options": { "default_quality": { "level": 0, "name": "超清", "resolution": "", "sdk_key": "origin", "v_codec": "" }, "qualities": [ { "level": 3, "name": "超清", "resolution": "720x1280", "sdk_key": "origin", "v_codec": "264" } ] }, "stream_data": "{\"common\":{\"session_id\":\"037-20200914230522010021067202095FE415\"},\"data\":{\"origin\":{\"main\":{\"flv\":\"http://pull-flv-f11.douyincdn.com/stage/stream-683385719577641061.flv\",\"hls\":\"http://pull-hls-f11.douyincdn.com/stage/stream-683385719577641061.m3u8\",\"cmaf\":\"\",\"dash\":\"\",\"sdk_params\":\"{\\\"VCodec\\\":\\\"h264\\\",\\\"gop\\\":4,\\\"resolution\\\":\\\"720x1280\\\",\\\"vbitrate\\\":909728000}\"}}}}" }, "push_data": { "push_stream_level": 0, "resolution_params": { "ld": { "default_bitrate": 800000, "fps": 15, "height": 848, "max_bitrate": 1333000, "min_bitrate": 320000, "width": 480 }, "sd": { "default_bitrate": 1000000, "fps": 15, "height": 960, "max_bitrate": 1600000, "min_bitrate": 500000, "width": 540 } } } }, "provider": 0, "push_urls": [ ], "resolution_name": { "FULL_HD1": "蓝光", "HD1": "超清", "ORIGION": "原画", "SD1": "标清", "SD2": "高清" }, "rtmp_pull_url": "http://pull-flv-f11.douyincdn.com/stage/stream-683385719577641061.flv", "rtmp_pull_url_params": "{\"VCodec\":\"h264\"}", "rtmp_push_url": "", "rtmp_push_url_params": "", "stream_control_type": 0 }, "sun_daily_icon_content": "", "tags": [ ], "title": "小鱼家????服饰正在直播", "top_fans": [ ], "use_filter": false, "user_count": 0, "user_share_text": "#在抖音，记录美好生活#【小鱼家服饰1店】正在直播，来和我一起反对TA吧。复制下方链接，关上【抖音短视频】，间接观看直播！", "vertical_cover_uri": "", "vid": "", "video_feed_tag": "直播中", "wait_copy": "失去急躁的期待将幸福擦肩而过", "web_count": 0, "webcast_comment_tcs": 0, "webcast_sdk_version": 0, "with_draw_something": false, "with_ktv": false, "with_linkmic": false }, "extra": { "now": 1600095922450 }, "status_code": 0 }, "msg": "success"}

November 3, 2020 · 6 min · jiezi

关于大数据:安利一个Python大数据分析神器

作者：东哥腾飞首发于公众号：Python数据迷信对于Pandas运行速度的晋升办法，之前曾经介绍过很多回了，外面常常提及Dask，很多敌人没接触过可能不太理解，明天就举荐一下这个神器。 1、什么是Dask？Pandas和Numpy大家都不生疏了，代码运行后数据都加载到RAM中，如果数据集特地大，咱们就会看到内存飙升。但有时要解决的数据并不适宜RAM，这时候Dask来了。 Dask是开源收费的。它是与其余社区我的项目（如Numpy，Pandas和Scikit-Learn）协调开发的。 官网：https://dask.org/Dask反对Pandas的DataFrame和NumpyArray的数据结构，并且既可在本地计算机上运行，也能够扩大到在集群上运行。 基本上，只有编写一次代码，应用一般的Pythonic语法，就可在本地运行或部署到多节点集群上。这自身就是一个很牛逼的性能了，但这还不是最牛逼的。 我感觉Dask的最牛逼的性能是：它兼容大部分咱们曾经在用的工具，并且只需改变大量的代码，就能够利用本人笔记本电脑上已有的解决能力并行运行代码。而并行处理数据就意味着更少的执行工夫，更少的等待时间和更多的剖析工夫。 上面这个就是Dask进行数据处理的大抵流程。 2、Dask反对哪些现有工具？这一点也是我比拟看中的，因为Dask能够与Python数据处理和建模的库包兼容，沿用库包的API，这对于Python使用者来说学习老本是极低的。而像Hadoop、Spark这种大数据处理是有很高的学习门槛和工夫老本的。 目前，Dask可反对pandas、Numpy、Sklearn、XGBoost、XArray、RAPIDS等等，光是这几项我感觉就足够用了，至多对于罕用的数据处理、建模剖析是齐全笼罩得掉的。 3、Dask装置能够应用 conda 或者 pip，或从源代码装置dask 。 conda install dask因为dask有很多依赖，所以为了疾速装置也可用上面代码，将装置运行Dask所需的起码依赖关系集。 conda install dask-core再有就是通过源来装置。 git clone https://github.com/dask/dask.gitcd daskpython -m pip install .4、Dask如何应用？Numpy、pandasDask引入了3个并行汇合，它们能够存储大于RAM的数据，这些汇合有DataFrame、Bags、Arrays。这些汇合类型中的每一个都可能应用在RAM和硬盘之间分区的数据，以及散布在群集中多个节点上的数据。 Dask的应用是十分清晰的，如果你应用NumPy数组，就从Dask数组开始，如果你应用Pandas DataFrame，就从Dask DataFrame开始，依此类推。 import dask.array as dax = da.random.uniform(low=0, high=10, size=(10000, 10000), # normal numpy code chunks=(1000, 1000)) # break into chunks of size 1000x1000y = x + x.T - x.mean(axis=0) # Use normal syntax for high level algorithms# DataFramesimport dask.dataframe as dddf = dd.read_csv('2018-*-*.csv', parse_dates='timestamp', # normal Pandas code blocksize=64000000) # break text into 64MB chunkss = df.groupby('name').balance.mean() # Use normal syntax for high level algorithms# Bags / listsimport dask.bag as dbb = db.read_text('*.json').map(json.loads)total = (b.filter(lambda d: d['name'] == 'Alice') .map(lambda d: d['balance']) .sum())这些高级接口在稍微变动的状况下复制了标准接口。对于原始我的项目中的大部分API，这些接口会主动为咱们并行处理较大的数据集，实现上不是很简单，对照Dask的doc文档即可一步步实现。 ...

November 2, 2020 · 2 min · jiezi

关于大数据:抖音视频Api带货相关

TiToData，业余的短视频数据采集、解决平台。 更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口带货视频随机举荐参数参数类型阐明tokenstring接口受权码cursorint翻页游标返回示例请分割：TiToData带货商品详情参数参数类型阐明tokenstring接口受权码pidint商品的promotion_id返回示例请分割：TiToData同款商品视频列表参数参数类型阐明tokenstring接口受权码pidint商品的promotion_id返回示例请分割：TiToData

November 1, 2020 · 1 min · jiezi

关于大数据:抖音视频Api话题和推荐

TiToData，业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博话题接口话题详情参数参数类型阐明tokenstring接口受权码chidint抖音话题challenge_id返回示例请分割：TiToData话题视频列表参数参数类型阐明tokenstring接口受权码chidint抖音话题challenge_idcursorint翻页游标，依据后果返回的cursor传入作为下一页翻页参数，初始为0返回示例请分割：TiToData举荐接口首页视频举荐参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData热门话题举荐参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData

October 31, 2020 · 1 min · jiezi

关于大数据:当我们在讨论实时性的时候我们在讨论什么

0 1谁更能从5G受害？对于5G，许多支流媒体都围绕个人消费的潜在市场报道，例如AR / VR游戏。 但事实如同很多行业分析师察看到的那样，电信服务提供商早就敏锐地意识到，将来的市场不是来自于个人用户，而是来自于那些加入第四次工业革命的企业，采纳大规模机器类型通信（mMTC）和超牢靠的低提早通信（uRLLC）等5G服务的互联网企业，将成为5G技术的次要受益者。 ▲ 3项5G的要害外围服务 0 2怎么利用5G？企业要利用5G的要害外围服务，就必须进行真正的数字化转型。首先，不要将数字化转型与现有的简略数字化相混同；其次，为了应答数字化转型，企业必须思考重新配置其业务流程，以利用机器对机器的通信来实现自动化流程、决策和口头，从而打消人为操作带来的潜在昂扬代价，同时缩短价值实现的工夫周期，让事件数据生成更靠近事件工夫。连贯各项业务的关键点是数据、业务规定、决策和与之匹配的口头。 很多企业曾经意识到，5G的速度和低提早能够将本人的竞争力晋升到新的高度，然而满足实时性需要，须要根本性的数字化转型改革。实时的定义是基于两个关键因素： “ 提早：从设施生成数据到数据价值夺取，通过了多长时间工作负载：在该延迟时间内须要实现哪些操作，才能够从数据中提取价值信息并造成决策 复杂性 V.S. 提早 如上图所示，对于简略的聚合和连贯而言，真正的事件驱动体系结构比事件驱动的流解决须要更多的资源。真正的实时工作负载至多须要7个步骤：摄取、存储、聚合、要害绩效指标测量、异样指标（偏差）的检测，解决这些简单偏差的决策以及采取适当措施（获利、威逼、预防）是基于决策步骤的后果，所有这些都须要在10毫秒甚至更短的工夫内实现。 如果错过解决工夫窗口，则要进入从新核查周期。当然，数据处理能力跟不上时，最坏的状况是会齐全消耗掉企业基础架构资源，并且这些数据将会没人晓得它们的存在，这是企业的数据噩梦。 03对于零碎主动决策设施零碎或人工操作员的行为如何影响零碎的主动决策呢？对于实时处理平台而言，重要的是不仅要解决数据流，还要将筹备好的训练数据推送到机器学习层，以消化或者创立新的数据模型。 一旦创立了新的数据模型，只须要将它纳入决策过程中，就能够实现零碎的主动决策了，通常实时数据处理和模型自动更新会以不同运行周期并行运行： “ 一个周期是事件产生到决策口头的周期，Gartner将其称为实时控制回路（Real-Time Control Loop）另一个周期是事件学习决策周期，它将流数据和大数据组合在一起，更新模型并治理假阳性或者假阴性的场景决策通过客户和合作伙伴的利用场景中打磨， VoltDB最后是一个分布式内存数据库，现已转变为一个整体的实时数据价值治理平台，该平台能够在动静数据流的环境中同时解决下面两个周期。 VoltDB中国联系方式：sgao##voltdb.com （请将“##”替换成“@”） 如果您对VoltDB的工业物联网大数据低提早计划或者全生命周期的实时数据平台治理感兴趣，欢送私信，进入到咱们的官网交换群。

October 30, 2020 · 1 min · jiezi

关于大数据:抖音视频Api榜单相关

TiToData，业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口明星榜参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData热点榜参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData直播榜参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData今日最热视频榜参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData人气好物榜参数参数类型阐明tokenstring接口受权码返回示例请分割：TiToData

October 30, 2020 · 1 min · jiezi

关于大数据:抖音视频Api达人信息

TiToData，业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口达人信息参数参数类型阐明tokenstring接口受权码uidstring用户user_id,非抖音号返回示例请分割：TiToData达人视频列表参数参数类型阐明tokenstring接口受权码uidstring用户user_id,非抖音号cursorint翻页游标，依据后果返回的max_cursor传入作为下一页翻页参数，初始为0返回示例请分割：TiToData达人商品橱窗参数参数类型阐明tokenstring接口受权码uidstring用户user_id,非抖音号cursorint翻页游标，依据后果返回的max_cursor传入作为下一页翻页参数，初始为0返回示例请分割：TiToData达人用户关注列表参数参数类型阐明tokenstring接口受权码uidstring用户user_id,非抖音号cursorint翻页游标，依据后果返回的max_cursor传入作为下一页翻页参数，初始为0返回示例请分割：TiToData达人用户喜爱列表参数参数类型阐明tokenstring接口受权码uidstring用户user_id,非抖音号cursorint翻页游标，依据后果返回的max_cursor传入作为下一页翻页参数，初始为0返回示例请分割：TiToData

October 26, 2020 · 1 min · jiezi

关于大数据:抖音视频Api搜索接口

TiToData，业余的短视频数据采集、解决平台。更多信息请分割： TiToData海量数据采集每天为客户采集5亿条数据笼罩支流平台：TikTok，Zynn，YouTube，抖音，快手，1688，小红书，拼多多，淘宝，美团，饿了么，淘宝，微博接口关键词搜寻用户参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词搜寻视频参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标sortint排序类型，最多点赞传入1，最新公布传入2，默认综合排序0ctimeint公布工夫，半年内传入183，一周内传入7，一天内传入1，默认不限0返回示例请分割：TiToData关键词搜寻话题参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词搜寻地址参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词搜寻音乐参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词搜寻直播参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词搜寻商品参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData关键词综合搜寻参数参数类型阐明keywordstring搜寻关键词cursorint翻页游标返回示例请分割：TiToData

October 25, 2020 · 1 min · jiezi

关于大数据:大数据上手实战训练营9营齐开第二季限时免费报名啦

8月18日，阿里巴巴大数据训练营“九营齐开”正式开营，来自数据计算、数据分析、数据仓库、搜寻、机器学习、数据智能等多个畛域的技术大佬亲自上阵教学，解读各技术畛域根底原理，分析行业实际案例，帮忙开发者实现大数据从0到1的上手学习。 首期大数据“9营齐开”打算吸引了10000+开发者报名参加，成为今夏最火爆的大数据训练营！随同着第一季训练营的完满闭幕，大数据训练营“九营齐开”第二季已蓄势待发！ 丰盛的课程设置 弱小的讲师阵容 精美的社区周边 第二季大数据训练营“九营齐开”全面降级！ 弱小的讲师阵容保障课程品质大数据训练营“9营齐开”由阿里云智能高级研究员贾扬清出品，实时计算 Flink、DataWorks、机器学习 PAI、MaxCompute、Hologres、搜寻与举荐技术、数据湖、Elasticsearch、开源 Spark 等多个技术/产品一线专家齐上阵，传授实战经验总结。 无论你是对老板的新我的项目无力招架，或是想实现多个我的项目的死记硬背，在这里讲师将分享本身我的项目开发思路，帮你建设多项技术之间的分割，实战利用更加得心应手。 笼罩多元热门技术畛域，总有一款适宜你“9营齐开”打算不仅蕴含数仓、实时计算、机器学习还新增了搜寻与举荐技术体验营、云原生数据湖体系训练营等时下热门技术畛域。课程设置也更多元，根底入门与进阶实战可自由选择，适应不同根底开发者的学习需要。 即便你是小白开发者，不晓得从哪里入门大数据，甚至已有实战根底，想要深刻学习中、高阶内容，大数据训练营都能帮忙你补充欠缺常识体系，积攒实战我的项目教训。 学习体验更敌对，满足你的“好奇心”每期训练营出品人将围绕某一核心技术及训练营直播课程布局课外阅读材料，提供从入门到上手的全套学习教材，保障实操演示与扩大浏览同步进行，让您免于“想自学没材料想实操没人教”的各种懊恼。同时，改善学习打卡体验，环节晦涩更敌对。此外，还有讲师小群互动答疑，满足你的“好奇心”。 如果你对课程内容有疑难，或是实战中遇到了难题与困惑，在这里都可间接向大佬取经，零距离与大佬交换，更快解决你的业务难题； 更多绝版周边等你拿训练营第二季推出“秋冬款”特色周边，定制公仔、新版卫衣、保温水壶、长袖T恤、雨伞等等...各种新款已就位，参加训练营打卡互动即有机会带回家！ （局部周边一览） “九营齐开”第二季训练营课程详情 大数据训练营“9营齐开”第二季正式开启！9大训练营限时收费报名中，最快3天带你轻松 Get 企业级的大数据实战能力，你还等什么？ 戳下方链接，报名心仪的训练营！???? 实时计算 Flink 中级训练营https://developer.aliyun.com/learning/trainingcamp/sc/3一站式大数据开发治理平台 DataWorks 中级训练营https://developer.aliyun.com/learning/trainingcamp/datawork/2搜寻与举荐技术体验营https://developer.aliyun.com/learning/trainingcamp/alrec/1云原生数据湖体系训练营https://developer.aliyun.com/learning/trainingcamp/datalake/1Elasticsearch 实战进阶营https://developer.aliyun.com/learning/trainingcamp/es/2SaaS 模式云数据仓库 中级训练营https://developer.aliyun.com/learning/trainingcamp/saas/2机器学习 PAI-DSW 入手实验室 训练营第二期https://developer.aliyun.com/learning/trainingcamp/pai/2实时数仓 Hologres 训练营https://developer.aliyun.com/learning/trainingcamp/holo/2开源 Spark 实战训练营第三期https://developer.aliyun.com/learning/trainingcamp/spark/3

October 23, 2020 · 1 min · jiezi

关于大数据:数据系统架构2元数据管理

1.元数据管理篇指标通过收集与整合各个系统信息，打造数据全链路血缘关系。 序场景1：报表A的数据和报表B的数据不统一，能帮忙看下是什么问题吗？场景2：我改变一个hive表，上游工作是否会有影响？场景3：原始日志打印字段构造变动了，我该告诉哪些人？ 上述的场景大抵上，就是在全链路中从源头找上游，或者是从上游找数据源头的问题。大多数状况下，咱们在一个零碎中是能在肯定水平上找到对应的数据依赖等关系的，然而跨零碎、跨模块之后很多时候除了对应的开发人员并不知道具体的信息了，比方一个报表对应的统计工作是哪个？口径是什么？个别只有对应开发人员分明，在排查口径问题的时候须要找到对应开发人员，能力找到对应的信息。那么咱们就须要这么一个元信息管理系统，通知每个人数据全链路的血缘关系，并且蕴含各种相干信息，缩小沟通老本、晋升数据问题排查与解决的效率。 接下来大抵介绍一下，各个模块咱们须要收集哪些信息，这些信息如何串联起来造成一个有机的整体，解决“数据迷雾”的问题。 元数据链路(图-整体架构详见第一篇数据之旅-开篇)咱们对照着大数据技术架构图，一步一步看看各个局部数据如何一步一步串联到一起。大抵上就是在收集与整顿，每个模块的输出与输入、内容是什么等相干信息。 最大可能通过各种系统管理获取各种信息，最差的状况在各个系统维护页面采纳手动录入。 整体链路：【根底数据】<->【数据存储-数据仓库】<->【任务调度关系】<->【后果数据存储】<->【数据利用】 1.【根底数据】<->【数据存储】 输出与输入：这2个模块之间的关系，保护来自【日志采集零碎】，如上篇文章中的设计，咱们能够从该零碎的得悉每一份前后端日志、源表被采集至哪个kafka中，保留至哪个HDFS目录里。内容：并且在【日志采集零碎】中，在申请的采集的时候，须要记录采集日志的内容，前端日志收集蕴含哪些pagetype与actiontype、后端日志收集action。就算过后没有精确记录，在后续的【日志形象-指标定义零碎】因为须要做统计开发，那须要反推数据保护，要不无奈定义数据指标口径。2.【数据存储-数据仓库】 离线的数据分为2种，构造数据和非结构化数据。 结构化的数据，如前端日志在上传至HDFS之后能够间接映射成前端日志表；非结构化的数据须要通过【配置化ETL】先通过一次ETL造成最根底的后端日志表。这2张前后端根底日志表和源表，就造成了数据仓库的根底，是之后数仓各个档次表的根基数据。 3.【数据存储-数据仓库】<->【任务调度关系】 离线数据仓库与工作的关系，能够通过2种形式收集，表述了Hive-Hive表的关系。 自动化：通过解析hiveSQL的语句中的输出与输入，收集到各个表之间的输出与输入关系；工作配置手动记录：在调度零碎中配置工作信息的时候，记录对应的输出与输出表信息。通过调度零碎，咱们能够得悉2个依赖，【工作依赖链路】与【表关系链路】，为之后通过【日志形象-指标定义零碎】定义指标买通表与指标打下数据根底。 实时工作 个性化开发：只能通过工作配置手动保护生产的topic信息，以及后续的输出信息；实时统计零碎数据：在配置统计规定的时候，即能够晓得对应工作应用了那个topic信息。4.【任务调度关系】<->【后果数据存储】 这一部分数据其实是整个链路中缺失最重大的局部，导致从数据上游找数据起源非常麻烦，咱们晓得一个数据来自某个表，这个表的数据来自哪个工作却不分明，目前采纳了在调度工作的名称上加上输入的形式，非常的不优雅和高效。 我想这部分最好是在调度零碎里进行充沛的集成，比方抽取工作、hive写入mysql表、hive写入redis、hbase等等，尽可能的把所有数据输入能够通过配置来实现数据的写入，解决后果数据输入到哪里的问题。 5.【后果数据存储】<->【数据利用】 数据集BI：这个数据展现零碎，能够通过SQL来定义数据集来实现数据的展现，零碎级别上因为存在配置信息，所以能够明确的晓得每个数据集中的表数据被利用展现到了哪里；烟囱式个性化报表：这个没有太好的方法，只能通过特定的性能来补录利用信息，对应的性能应该反对各类利用数据起源信息的配置，达到数据链路一个补充的性能。成果至此，大抵通过以上的信息收集与全链路数据关系的买通，咱们大抵能够解决最开始所形容的那些问题。 离线利用->源头：报表->数据集/个性化利用信息->数据存储->数据工作->工作/表依赖链路->日志；实时利用->源头：实时报表->数据存储->数据工作->topic->日志同时咱们要开发一个对外提供查问的零碎，这样无论正向还是反向查找，咱们都能充沛的理解数据链路上的每个环节，在数据问题排查的状况下升高沟通老本，进步整体数据开发全流程的效率与品质。

October 19, 2020 · 1 min · jiezi

关于大数据:jenkins-trigger-by-time

对于须要定时触发 jenkins pipline的api，此我的项目能够作为一个参考本文由博客群发一文多发等经营工具平台 OpenWrite 公布

October 16, 2020 · 1 min · jiezi

关于大数据:MinIO的搭建使用

MinIO的搭建应用是什么MinIO是一个基于Apache License v2.0开源协定的高性能的对象存储，它兼容亚马逊S3云存储服务接口 适宜大容量的文件存储，如：图片，视频等文件，通常用于作为机器学习，剖析的高性能的基础设施，且反对分布式部署 搭建须要在本地有Docker docker run -p 9000:9000 \ -e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" \ -e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" \ minio/minio server /data应用拜访localhost:9000,则能够间接看到UI界面输出ACCESS_KEY=AKIAIOSFODNN7EXAMPLE SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY到这里，本人搭建一个MinIO测试，曾经齐全满足要求了 进一步应用当然除了ui操作，也有CLI操作,具体的操作能够本人多练习练习更多对于MinIO，参照这里 本文由博客群发一文多发等经营工具平台 OpenWrite 公布

October 16, 2020 · 1 min · jiezi

关于大数据:小红书推荐大数据在阿里云上的实践

本篇内容次要分三个局部，在第一局部讲一下实时计算在举荐业务中的应用场景。第二局部讲一下小红书是怎么应用Flink的一些新的性能。第三局部次要是讲一些OLAP的实时剖析的场景，以及和阿里云MC-Hologres的单干。 作者：小红书举荐工程负责人 郭一 小红书举荐业务架构首先这个图上画了一些比拟典型的举荐业务，应用大数据的次要模块，其中最右边是线上举荐引擎，个别举荐引擎会分成召回、排序、后排等几步，在这里就不细说了。次要是从大数据的角度来说，举荐引擎次要是使用预测模型来预估用户对每个候选笔记的喜爱水平。依据肯定的策略来决定给用户举荐哪些笔记。举荐模型在使用时须要抓取笔记特色，这些特色又会回流到咱们的训练数据中，来训练新的模型。举荐引擎返回笔记之后，用户对笔记的消费行为，包含展现、点击、点赞等行为，会造成用户的行为流。这些用户行为流联合了特色流，从而产生了模型训练的数据来迭代模型。联合用户和笔记的信息之后，就会产生用户和笔记画像和举荐业务所用到的一些剖析报表。通过一年多的革新，小红书在举荐场景中，除了从剖析数据到策略这一块，须要人为参加迭代策略之外，其余的模块的更新基本上是做到了实时或近实时的进行。 举荐业务的实时计算利用这里略微开展讲一下特色和用户行为的数据回流之后的实时计算，以及咱们怎么应用他们产生的数据。在举荐引擎产生特色流的时候，特色流因为量特地大，包含了所有举荐返回的笔记，大略有近百篇，以及这些笔记的所有特色，所以这些特色总共大略有大几百个。目前咱们的做法是把特色写到一个咱们自研的高效的kv中缓存几个小时，而后用户行为数据是从客户端打点回流，而后咱们就开始了数据流的解决。咱们第一步是把客户端打点的用户行为进行归因和汇总。这里讲一下什么是归因和汇总。因为在小红书的APP下面，客户端的打点是分页面的，比如说用户在首页举荐中看了笔记并进行了点击，点击之后用户就会跳转到笔记页，而后用户在笔记页上浏览这篇笔记并进行点赞。同时用户可能会点击作者的头像进入作者的集体页，并在集体页中关注了作者。归因是指把这一系列的用户行为都要算作首页举荐产生的行为，而不会和其余的业务混起来。因为搜寻用户，在搜寻中看到同样一篇笔记，也可能返回同样的后果。所以咱们要辨别用户的行为到底是由哪一个业务所产生的，这个是归因。 而后汇总指的是用户的这一系列行为，对于同一篇笔记，咱们会产生一条汇总的记录，汇总的记录能够便于后续的剖析。而后归因之后，会有一个实时的单条用户行为的数据流。而汇总这边，因为有一个窗口期，所以汇总的数据个别会提早目前大略是20分钟左右。当咱们产生归因和汇总的数据流之后，咱们就会补充上一些维表的数据，咱们会依据用户笔记来找过后咱们举荐产生的特色，同时咱们也会把一些用户的根底信息和笔记的根底信息加到数据流上。这外面其实次要有4个比拟重要的用户场景，第一个场景是产生分业务的Breakdown的信息，这个次要是能晓得某一个用户在不同的笔记维度，他的点击率和一些其余的业务指标，同时我也能够晓得某一篇笔记针对不同的用户，它产生的点击率，这个是咱们在实时举荐当中一个比拟重要的特色。另外一个很重要的是咱们实时剖析的一个宽表，宽表是咱们把用户的信息、笔记信息和用户笔记交互的汇总信息，都变成了一个多维度的表，进行实时剖析，这个前面会更加具体的和大家讲述。而后还有两个比拟重要的，一个是实时训练的信息，训练的信息就是我把用户和笔记交互的信息裁减了，过后排序的时候抓起的特色，这特色加上一些咱们汇总进去的标签，就给模型进行训练来更新模型。而后另外一个就是我所有的汇总信息都会进入离线数据数仓，而后会进行后续的一些剖析和报表的解决。 流计算优化—Flink批流一体而后我这里讲一下咱们怎么使用Flink的一些新性能来优化流计算的过程。这外面我次要讲两点，其中第一点就是批流一体化。方才说了咱们把一个用户的行为依据笔记的行为汇总之后进行剖析，这里的汇总的信息其实很多的，汇总信息当中，除了最简略的，比如说用户有没有点赞珍藏这篇笔记，其实还有一些比较复杂的标签，比如说用户在笔记页上停留了多长时间，或者是说这篇笔记之前的点击是不是一个无效点击，咱们对于某些广告场景或者有些场景上面，咱们须要晓得如果用户点击之后停留了比如说超过5秒，那么这个点击是无效的。那么像这种简单的逻辑，咱们心愿在咱们的零碎当中只被实现一次，就能够同时使用在实时和批的计算当中。那么在传统意义上这点是很难的，因为大多数的实现中，批和流是两个版本，就是咱们在Flink下面，比如说实现了一个版本的无效点击的定义，咱们同时也会须要实现一个离线版本的无效点击的定义，这个可能是一个SQL写的版本。那么小红书是使用了FLIP-27外面的一个新的性能，日志文件是一个批的模式，它能够转换成一个流的模式，这样的话我就能够做到代码意义上的批流对立。 流计算优化—Multi-sink Optimization那么还有一个Flink的性能就是一个在Flink 1.11上的Multi-sink Optimization。它的意思是我一份数据会写到多个数据利用下来，比方我会同时须要做张用户行为的宽表，同时也生成一份离线的数据。那么Multi-sink Optimization做的是，你只须要从Kafka外面读一次，如果是同一个key的话，他只须要去Lookup一次kv就能够产生多份数据，同时写到多个sink，这样能够大大减少咱们对Kafka的压力和对 kv查问的压力。 小红书OLAP典型场景最初我讲一下咱们的OLAP场景和阿里云MaxCompute、Hologres的一个单干。小红书在举荐业务上面有很多OLAP场景，这里我讲4个比拟常见的场景利用，最常见的其实就是依据用户的实验组分组进行比拟的一个实时剖析。因为咱们在举荐业务下面须要大量的调整策略或者是更新模型，而后每次调整策略和更新模型咱们都会开一个试验，把用户放到不同的ABtest外面来比拟用户的行为。那么一个用户其实在举荐当中会同时处于多个试验，在每一个试验外面是属于一个实验组，咱们按试验分组做的试验剖析，次要就是把一个试验拿进去，而后把用户的行为和汇总数据，依据这个试验当中的实验组进行分维度的剖析，看看不同的实验组它的用户指标有什么差异。而后这个场景是一个十分常见的场景，然而也是计算量十分大的场景，因为它须要依据用户的试验tag进行分组。而后另外一个场景就是咱们小红书的举荐其实是跑在了多个数据中心下面，不同的数据中心常常有一些变动，比如说是运维的变动，咱们要起一个新的服务，或者是咱们可能有些新的模型须要在某个计算中心先上线，那么咱们须要一个端到端的计划去验证不同的数据中心之间的数据是不是统一，用户在不同数据中心的体验是不是一样。这个时候就须要咱们依据不同的数据中心进行比拟，比拟用户在不同的数据中心当中产生的行为，他们最终的指标是不是统一，同样咱们也用到了咱们的模型和代码的公布当中。咱们会看一个模型公布或者一份代码公布的老版本和新版本，他们产生的用户的行为的指标比照，看他们是不是统一。同样咱们的OLAP还用在了实时业务指标的告警，如果用户的点击率和用户的点赞数忽然有一个大幅的降落，也会触发咱们的实时的告警。 小红书OLAP数据的规模在顶峰时候咱们大略每秒钟有35万条用户行为被记入咱们的实时计算当中。而后咱们大宽表大略有300个字段，而后咱们心愿可能放弃两周多大略15天左右的数据，因为咱们在做试验剖析的时候，常常须要看本周和上一周的数据的比照，而后咱们大略每天有近千次的查问。 小红书+Hologres咱们在7月和阿里云的MaxComputer和Hologres进行了一个单干。Hologres其实是新一代的智能数仓的解决方案，它可能把实时和离线的计算都通过一站式的办法来解决。同时它的利用次要能够用在实时大屏、Tableau和数据迷信当中，咱们钻研下来是比拟适宜咱们的举荐场景的。 小红书Hologres利用场景Hologres做的事件次要是对离线的数据进行了查问和减速，而后对离线的数据做表级别的交互查问响应，他就无须再做从离线把数据搬到实时数仓的这么一个工作，因为它都在外面了。整个实时数仓，它是通过搭建用户洞察体系，实时监控平台的用户数据，能够从不同的角度对用户进行实时诊断，这样能够帮忙施行精细化的经营。这个其实对于咱们用户大宽表来说也是一个非常适合的场景。而后它的实时离线的联邦计算能够基于实时计算引擎和离线数仓MaxCompute交互剖析，实时离线联邦查问，构筑全链路精细化经营。 Hologres VS  Clickhouse在和阿里云MaxCompute单干之前，咱们是自建了Clickhouse的集群，过后咱们也是一个很大规模的集群，一共用了1320个core，因为Clickhouse它不是一个计算存储拆散的计划，所以过后咱们为了节约老本，只寄存了7天的数据，而后因为Clickhouse对于用户试验tag这个场景其实没有很好的优化，所以说咱们过后查问超过三天的数据就会特地慢。因为是个OLAP场景，咱们心愿每次用户的查问能在两分钟之内出后果，所以是限度了咱们只能查过来三天的数据。同时另外还有一个问题就是Clickhouse对于组件的反对是有些问题的，所以咱们没有在Clickhouse集群下面配置组件，如果上游的数据流有些抖动，数据造成一些反复的状况下，上游的Clickhouse外面其实会有一些反复的数据。同时咱们也是派了专人去运维Clickhouse，而后咱们通过调研发现，Clickhouse如果你要做成集群版的话，它的运维老本还是很高的。所以咱们在7月份的时候和阿里云单干，把咱们举荐的一个最大的用户宽表迁徙到了MaxCompute和Hologres下面，而后咱们在Hologres下面一共是1200个core，因为它是计算存储的计划，所以1200个core就足够咱们应用了。然而咱们在存储的方面是有更大的需要的，咱们一共存了15天的数据，而后因为Hologres对于用户依据试验分组这个场景是做了一些比拟定制化的优化，所以说咱们当初能够轻松地查问7天到15天的数据，在这个依据实验组分组的场景上面，其查问的性能与Clickhouse相比是有大幅晋升的。Hologres它其实也反对Primary Key，所以咱们也是配置了Primary Key，咱们在这个场景上面是用了insert or ignore这个办法，而后因为配置了Primary Key，它就人造具备去重的性能，这样的话咱们上游只有保障at least once，上游的数据就不会有反复。 而后因为咱们是放在阿里云下面，所以说是没有任何的运维的老本。 材料下载点击下载》》材料。

October 16, 2020 · 1 min · jiezi

关于大数据:结合公司现状浅谈CMDB

本篇文章联合参考资料中的几篇CMDB的文章再加上目前公司的现状谈一谈CMDB。 CMDB概述CMDB：configuration management database，配置管理数据库。CMDB实质上是一个数据库，提供数据的存储、查问、校验等操作，是一个集中式的数据托管核心，托管的内容蕴含所有的软硬件资产（configuration items）。各个部门各个团队各个系统上司的各种重要的软硬件资产都属于CMDB对立治理的内容。 公司运维现状资产现状 全国各地区内网不互通。这个就是现状了，因为公司产品是为国家服务，所以全国各地的环境都在各自的内网中，安全性极高，在这种状况下，每个地区都配置了几个运维手工保护当地的环境，内外网齐全隔离。 运维状况现状 因为公司资产地区扩散且网络不互通，因而公司的自动化运维水平根本为0。整体上来说没有运维开发的岗位，目前的运维依然停留在人工运维联合shell脚本的时代，这些其实都算不上自动化运维，前段时间，开始搞ansible自动化部署和降级的事件，整个过程都是shell脚本实现。为了管制人力老本，甚至否定一些用新技术。拿Python这门语言来说，自身很适宜自动化运维，用于自动化降级那是再适宜不过了，尽管底层会依赖shell，然而Python写进去的逻辑必然会更分明，然而下层思考到后续保护人员须要把握Python和shell两种技术，最终还是否定了Python，其实也就是否定了自动化运维。转而几种人员去钻研日志核心和nagios监控，自动化运维的事件也天然不了了之。 <!--more--> CMDB现状目前公司外面还没有产生建设CMDB的萌芽，资产治理部门和运维核心团队有本人的配置库，也就是自建库。然而并没有将产品团队的软件资产列入配置管理的范畴。各个产品团队应用Confluence文档服务器或者Excel表格（这种状况较多）治理本人的软硬件资源，并称之为资源台账。就服务器而言，常常不晓得一个ip对应的服务器是否正在应用，由谁应用，这些信息无所不知。如果各个团队应用自建库，而不是通过文档模式来治理，那这种CMDB最多也只能算是各自为政的CMDB，并不是集中式的数据托管。 CMDB设计最简略的设计：一种配置一个表比方，ip独自成表，host独自成表 长处：配置简略直观 毛病：一旦某种配置须要批改字段，就须要批改代码，代码保护老本太高 简单点的设计：列式数据存储表名，列名，列值，行离开寄存到四张张表(schema, filed, value, entity) schema：一个配置表在schema中就是一条记录，记录表的信息和形容。field：每一列的列名和列相干的meta信息都寄存在field表中。entity：当作rowid应用，示意惟一掂量传统意义上的一行数据。value：寄存每一条记录的每一列的值，即一个entity和一个field既能够确定一个值。表的设计如下图： 整个设计的sql如下： -- MySQL Workbench Forward EngineeringSET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0;SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0;SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='TRADITIONAL,ALLOW_INVALID_DATES';-- ------------------------------------------------------- Schema mydb-- ------------------------------------------------------- ------------------------------------------------------- Schema mydb-- -----------------------------------------------------CREATE SCHEMA IF NOT EXISTS `mydb` DEFAULT CHARACTER SET utf8 ;USE `mydb` ;-- ------------------------------------------------------- Table `mydb`.`schema`-- -----------------------------------------------------CREATE TABLE IF NOT EXISTS `mydb`.`schema` ( `id` INT NOT NULL AUTO_INCREMENT, `name` VARCHAR(45) NOT NULL, `desc` TEXT NULL, PRIMARY KEY (`id`), UNIQUE INDEX `name_UNIQUE` (`name` ASC))ENGINE = InnoDB;-- ------------------------------------------------------- Table `mydb`.`field`-- -----------------------------------------------------CREATE TABLE IF NOT EXISTS `mydb`.`field` ( `id` INT NOT NULL AUTO_INCREMENT, `name` VARCHAR(45) NOT NULL, `meta` TEXT NULL, `schema_id` INT NOT NULL, PRIMARY KEY (`id`), INDEX `fk_field_schema_idx` (`schema_id` ASC), CONSTRAINT `fk_field_schema` FOREIGN KEY (`schema_id`) REFERENCES `mydb`.`schema` (`id`) ON DELETE NO ACTION ON UPDATE NO ACTION)ENGINE = InnoDB;-- ------------------------------------------------------- Table `mydb`.`entity`-- -----------------------------------------------------CREATE TABLE IF NOT EXISTS `mydb`.`entity` ( `id` INT NOT NULL AUTO_INCREMENT, `key` VARCHAR(45) NOT NULL, `schema_id` INT NOT NULL, PRIMARY KEY (`id`), INDEX `fk_entity_schema1_idx` (`schema_id` ASC), CONSTRAINT `fk_entity_schema1` FOREIGN KEY (`schema_id`) REFERENCES `mydb`.`schema` (`id`) ON DELETE NO ACTION ON UPDATE NO ACTION)ENGINE = InnoDB;-- ------------------------------------------------------- Table `mydb`.`value`-- -----------------------------------------------------CREATE TABLE IF NOT EXISTS `mydb`.`value` ( `id` INT NOT NULL AUTO_INCREMENT, `value` TEXT NOT NULL, `field_id` INT NOT NULL, `entity_id` INT NOT NULL, PRIMARY KEY (`id`), INDEX `fk_value_field1_idx` (`field_id` ASC), INDEX `fk_value_entity1_idx` (`entity_id` ASC), INDEX `ux_value` (`field_id` ASC, `entity_id` ASC), CONSTRAINT `fk_value_field1` FOREIGN KEY (`field_id`) REFERENCES `mydb`.`field` (`id`) ON DELETE NO ACTION ON UPDATE NO ACTION, CONSTRAINT `fk_value_entity1` FOREIGN KEY (`entity_id`) REFERENCES `mydb`.`entity` (`id`) ON DELETE NO ACTION ON UPDATE NO ACTION)ENGINE = InnoDB;SET SQL_MODE=@OLD_SQL_MODE;SET FOREIGN_KEY_CHECKS=@OLD_FOREIGN_KEY_CHECKS;SET UNIQUE_CHECKS=@OLD_UNIQUE_CHECKS;数据库查问时须要提供(entity, schema, field, value)这样一个四元组能力失去后果。 ...

October 13, 2020 · 2 min · jiezi

关于大数据:云上的可观察性数据中台如何构建

简介： 作为阿里经济体基础设施的阿里云日志服务（SLS），服务了上万级的用户，每天解决20PB日志/Metric/Trace数据，为AIOps、大数据分析、经营服务、大数据安全等场景提供撑持，解决工程师可察看性的问题。通过几年的锻炼和演进，正在向对立的可察看性中台倒退。本文分享阿里云存储团队构建SLS中台的背景和设计中的Trade Off，并通过两个最佳实际介绍如何通过中台构建智能的应用程序。 笔者是飞天最早的研发人员之一，已经参加从0到5000台飞天集群和操作系统的构建。飞天是一个宏大的软件系统，既有十分多的模块，也要跑在几万台物理机上，如何让分布式软件高效地运行离不开监控、性能剖析等环节，因而在飞天研发的第一天咱们就同时开始研发飞天监控零碎“神农”。神农通过采集大量的零碎数据，帮忙咱们更好地了解零碎、软件合作复杂性背地的关系。同时神农也在随同着越来越大、越来越多海内外集群的飞天操作系统成长，撑持阿里巴巴团体和阿里云的业务。在2015年，经验过一番思考，咱们决定把神农形象成一个更底层的服务——SLS（日志服务，第一天次要focus在日志场景中），心愿通过SLS可能服务撑持更多的Ops场景，包含AIOps（智能剖析引擎）。 一 构建可察看性中台的背景先说说从一个工程师的角度看到的变动：对一个工程师而言，5年前的工作是十分细分的，研发的工作就是把代码开发好。但随着互联网的倒退，业务零碎Scope越来越大，须要在品质、可用性和可运维性上有更高的要求。并且为了保障咱们的业务是继续改良的，必须在工作中波及到更多经营的因素，例如统计零碎拜访、留存和体验等状况。 从集体视角转化到行业视角也能发现一个趋势：在十几年前，研发的工夫会花在三个局部：翻新（编码），部署+上线，察看+剖析，并且部署+上线会破费大量的工夫。近几年云计算和云原生的衰亡解放了开发运维在部署、上线和环境标准化上的精力。但业务的高要求须要在各个环节中承当更大的Scope，从多个视角来对待问题。背地就会有大量、碎片化的数据分析工作。 如果咱们把具体的数据分析工作进行拆分，能够拆解成一个简略的黑盒。黑盒的右边是数据源，左边是咱们对数据源观测判断后的口头。例如： 在平安场景中，平安经营工程师会采集防火墙、主机、零碎等日志、依据教训对日志进行建模，辨认其中的高危操作，生成关键性事件，零碎依据多个事件进行告警。在监控和经营场景中，这个过程是相似的。无非是把数据源和建模的办法做了替换。所以咱们能够看到，尽管各个场景角色不同，数据源不同，但在机制上咱们是能够建设一套系统性剖析框架来承载这类可察看性的需要的。 二 中台的技术挑战构建中台的思路看起来很间接，要做这件事件有哪些挑战呢？ 咱们能够从数据源、剖析和判断这三个过程来剖析： 第一大挑战来自于数据源接入。以监控场景为例，业界有不同的可视化、采集、剖析工具针对不同的数据源。为了能建设监控可察看性体系，须要引入大量的垂直零碎。这些零碎之间有不同的存储格局，接口不对立，有不同的软件体验，往往难以造成合力。第二大挑战来自于性能与速度。数据分析的过程实际上是把专家教训（Domain Knowledge）积淀的过程，而Ops场景个别都是Mission Critical过程，因而须要十分快地剖析速度和所见即所得能力。第三大挑战来自于剖析能力。在接入足够多的数据后，往往会面临监控项太多，数据量太多，线索太多等问题，咱们须要有成套的办法帮忙咱们去降维、去发现、去关联、去推理。AIOps算法目前聚焦在这一层上。前两个问题实质上是一个零碎问题，而前面两个问题和算法与算力相干。中台的推出能够解决第1和第2个问题。 三 阿里云SLS，自研自用可察看性中台2015年咱们研发了SLS，通过几年的锻炼和演进，正在向对立的可察看性中台倒退。SLS向下对接各种开源的协定与数据源，向上对各种场景提供撑持能力。外围能力在于围绕可察看性的各种监控数据，提供对立的存储与计算能力，平台能够用 “1、2、3、4” 四个词来概括。 “1” 代表一个中台。“2” 代表提供两种根本的存储模型：Logstore与MetricStore，别离面向适宜Trace/Log类型的日志存储（Logstore），适宜监控数据Metric类型的时序存储（MetricStore）。这两种存储并不是孤立的，建设在对立的存储概念上，并且能够非常灵活的互相转化。“3” 代表三类剖析引擎：数据加工引擎（DSL）、SQL查问剖析引擎（SQL）、智能剖析引擎（AIOps）。DSL次要面向数据加工和与预处理场景，解决格局多样化的问题；SQL查问剖析引擎面向存储数据提供荡涤、计算能力；而内嵌的AIOps能够给特定问题提供智能算法。“4” 代表四类典型场景：例如ITOps、DevOps、SecOps、BusinessOps等。波及到运维、研发、经营和黑客增长等畛域。阿里团体80%以上相似场景都基于SLS来构建。平台始终向用户提供撑持能力，兼容各种数据源与协定，撑持业务但不做业务产品。 1 存储设计为了构建可察看性的中台，咱们先看看目前存储系统的现状。在运维畛域AIOps零碎的构建过程中，长期并存四种类型的存储系统，别离是： Hadoop/Hive：寄存历史日志，Metric等数据，存储老本便宜，剖析能力较强，但延时较高。ElasticSearch：寄存须要实时拜访的Trace，Log信息，检索速度快，但老本较高，适宜近线的热数据，剖析能力中等。NoSQL：用来存储通过聚合的指标类数据，TSDB类是NoSQL存储扩大，检索聚合后的指标速度快，老本较便宜，毛病是剖析能力较弱。Kafka：用来导入导出路由各种数据，次要存储长期数据，上下游接口丰盛，没有剖析能力。 这四类独立的存储系统较好地解决了四种不同类型的需要，但存在两大挑战： 数据流动性 数据存储后可能撑持某个场景的服务能力，但随之而来的问题就是流动性。数据存在于多个零碎中，做数据关联、比照、整合时就须要去搬数据，这往往须要破费十分多的工夫。 接口易用性 面对不同的存储对象的接口不对立，例如Log个别应用ES的API来包装，而Metric个别会用Prometheus协定或通过NoSQL接口间接调用等等。为了集成数据往往须要波及到不同的API与交互方式，减少了零碎的整体复杂性。 目前四种存储系统的现状导致数据应用须要较长的周期及肯定的开发量，限度了AIOps，DataOps等场景施展更大的作用。 2 如何形象存储如果咱们把监控数据的生成过程做一个形象，能够发现个别会由两个过程组成：变动+状态。所有的事物都是一个待续变动的过程，例如数据库的一张表在某一个时刻（例如2点）的状态实际上是由历史上所有变动累计的后果。在监控畛域中也是一样，咱们能够通过Log、Trace等形式把零碎状态的变动尽可能保留（或采样）下来。例如用户在1小时内做了5次操作，咱们能够把这5次操作的日志或Trace捕获下来。当咱们须要一个状态值时（比方2点的零碎状态是什么），咱们能够对这些所有的操作日志做一个回放，造成某一个工夫点的一个汇总值，例如在窗口大小为1小时的区间内，操作QPS为5。这里就是一个简略的Log转为Metric的关系，咱们能够应用其余逻辑，例如对Log中的Latency字段做一个Avg来取得该窗口的Latency。 在SLS存储设计的过程中，咱们也遵循了这样的客观规律： 底层提供了一个FIFO Binlog队列，数据写入和读取都是程序的，以严格的写入工夫（Arrival Time）作为排序。在Binlog之上，咱们能够筛选某些字段生成一个Logstore，Logstore能够认为是数据库的一个表：是带Schema的，至多有EventTime这个字段（事件产生的原始工夫），能够指定列的类型和名字。这样咱们就能够通过关键词和SQL检索Logstore中的内容。除此之外，咱们能够依据需要对Logstore中的某些列生成多个Metric存储，例如依据Host+Method+Time构建一个以Host+Method作为Instance的监控数据存储表，从而能够依据时间段把数据捞出。让咱们来看一个例子：以下是一个站点的拜访记录，在1秒内经验了4次访问。 time, host, method, latency, uid, status[2020-08-10 17:00:00, Site1, UserLogin, 45ms, 1001, OK][2020-08-10 17:00:01, Site1, UserBuy, 25ms, 1001, OK][2020-08-10 17:00:01, Site1, UserBuy, 1ms, 1001, OK][2020-08-10 17:00:01, Site1, UserLogout, 45ms, 1001, OK][2020-08-10 17:00:01, Site2, UserLogin, 45ms,1002, Fail]当这些数据写入Logstore后，相当于写入了一张寄存日志的数据库，能够通过SQL对其中任意字段进行查问与剖析。例如“ select count(1) as qps”，取得以后汇总的QPS。 ...

October 12, 2020 · 1 min · jiezi

关于大数据:赵强老师Flink的DataSet算子

Flink为了可能解决有边界的数据集和无边界的数据集，提供了对应的DataSet API和DataStream API。咱们能够开发对应的Java程序或者Scala程序来实现相应的性能。上面举例了一些DataSet API中的根本的算子。 上面咱们通过具体的代码来为大家演示每个算子的作用。 1、Map、FlatMap与MapPartition//获取运行环境ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();ArrayList<String> data = new ArrayList<String>();data.add("I love Beijing");data.add("I love China");data.add("Beijing is the capital of China");DataSource<String> text = env.fromCollection(data);DataSet<List<String>> mapData = text.map(new MapFunction<String, List<String>>() { public List<String> map(String data) throws Exception { String[] words = data.split(" "); //创立一个List List<String> result = new ArrayList<String>(); for(String w:words){ result.add(w); } return result; }});mapData.print();System.out.println("*****************************************");DataSet<String> flatMapData = text.flatMap(new FlatMapFunction<String, String>() { public void flatMap(String data, Collector<String> collection) throws Exception { String[] words = data.split(" "); for(String w:words){ collection.collect(w); } }});flatMapData.print();System.out.println("*****************************************");/* new MapPartitionFunction<String, String> 第一个String：示意分区中的数据元素类型 第二个String：示意解决后的数据元素类型*/DataSet<String> mapPartitionData = text.mapPartition(new MapPartitionFunction<String, String>() { public void mapPartition(Iterable<String> values, Collector<String> out) throws Exception { //针对分区进行操作的益处是：比方要进行数据库的操作，一个分区只须要创立一个Connection //values中保留了一个分区的数据 Iterator<String> it = values.iterator(); while (it.hasNext()) { String next = it.next(); String[] split = next.split(" "); for (String word : split) { out.collect(word); } } //敞开链接 }});mapPartitionData.print();2、Filter与Distinct//获取运行环境ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();ArrayList<String> data = new ArrayList<String>();data.add("I love Beijing");data.add("I love China");data.add("Beijing is the capital of China");DataSource<String> text = env.fromCollection(data);DataSet<String> flatMapData = text.flatMap(new FlatMapFunction<String, String>() { public void flatMap(String data, Collector<String> collection) throws Exception { String[] words = data.split(" "); for(String w:words){ collection.collect(w); } }});//去掉反复的单词flatMapData.distinct().print();System.out.println("*********************");//选出长度大于3的单词flatMapData.filter(new FilterFunction<String>() { public boolean filter(String word) throws Exception { int length = word.length(); return length>3?true:false; }}).print();3、Join操作//获取运行的环境ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();//创立第一张表：用户ID 姓名ArrayList<Tuple2<Integer, String>> data1 = new ArrayList<Tuple2<Integer,String>>();data1.add(new Tuple2(1,"Tom"));data1.add(new Tuple2(2,"Mike"));data1.add(new Tuple2(3,"Mary"));data1.add(new Tuple2(4,"Jone"));//创立第二张表：用户ID 所在的城市ArrayList<Tuple2<Integer, String>> data2 = new ArrayList<Tuple2<Integer,String>>();data2.add(new Tuple2(1,"北京"));data2.add(new Tuple2(2,"上海"));data2.add(new Tuple2(3,"广州"));data2.add(new Tuple2(4,"重庆"));//实现join的多表查问：用户ID 姓名 所在的程序DataSet<Tuple2<Integer, String>> table1 = env.fromCollection(data1);DataSet<Tuple2<Integer, String>> table2 = env.fromCollection(data2);table1.join(table2).where(0).equalTo(0)/*第一个Tuple2<Integer,String>：示意第一张表 * 第二个Tuple2<Integer,String>：示意第二张表 * Tuple3<Integer,String, String>：多表join连贯查问后的返回后果 */ .with(new JoinFunction<Tuple2<Integer,String>, Tuple2<Integer,String>, Tuple3<Integer,String, String>>() { public Tuple3<Integer, String, String> join(Tuple2<Integer, String> table1, Tuple2<Integer, String> table2) throws Exception { return new Tuple3<Integer, String, String>(table1.f0,table1.f1,table2.f1); } }).print();4、笛卡尔积ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();//创立第一张表：用户ID 姓名ArrayList<Tuple2<Integer, String>> data1 = new ArrayList<Tuple2<Integer,String>>();data1.add(new Tuple2(1,"Tom"));data1.add(new Tuple2(2,"Mike"));data1.add(new Tuple2(3,"Mary"));data1.add(new Tuple2(4,"Jone"));//创立第二张表：用户ID 所在的城市ArrayList<Tuple2<Integer, String>> data2 = new ArrayList<Tuple2<Integer,String>>();data2.add(new Tuple2(1,"北京"));data2.add(new Tuple2(2,"上海"));data2.add(new Tuple2(3,"广州"));data2.add(new Tuple2(4,"重庆"));//实现join的多表查问：用户ID 姓名 所在的程序DataSet<Tuple2<Integer, String>> table1 = env.fromCollection(data1);DataSet<Tuple2<Integer, String>> table2 = env.fromCollection(data2);//生成笛卡尔积table1.cross(table2).print();5、First-NExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();//这里的数据是：员工姓名、薪水、部门号DataSet<Tuple3<String, Integer,Integer>> grade = env.fromElements(new Tuple3<String, Integer,Integer>("Tom",1000,10), new Tuple3<String, Integer,Integer>("Mary",1500,20), new Tuple3<String, Integer,Integer>("Mike",1200,30), new Tuple3<String, Integer,Integer>("Jerry",2000,10));//依照插入程序取前三条记录grade.first(3).print();System.out.println("**********************");//先依照部门号排序，在依照薪水排序grade.sortPartition(2, Order.ASCENDING).sortPartition(1, Order.ASCENDING).print();System.out.println("**********************");//依照部门号分组，求每组的第一条记录grade.groupBy(2).first(1).print();6、外链接操作ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();//创立第一张表：用户ID 姓名ArrayList<Tuple2<Integer, String>> data1 = new ArrayList<Tuple2<Integer,String>>();data1.add(new Tuple2(1,"Tom"));data1.add(new Tuple2(3,"Mary"));data1.add(new Tuple2(4,"Jone"));//创立第二张表：用户ID 所在的城市ArrayList<Tuple2<Integer, String>> data2 = new ArrayList<Tuple2<Integer,String>>();data2.add(new Tuple2(1,"北京"));data2.add(new Tuple2(2,"上海"));data2.add(new Tuple2(4,"重庆"));//实现join的多表查问：用户ID 姓名 所在的程序DataSet<Tuple2<Integer, String>> table1 = env.fromCollection(data1);DataSet<Tuple2<Integer, String>> table2 = env.fromCollection(data2);//左外连贯table1.leftOuterJoin(table2).where(0).equalTo(0) .with(new JoinFunction<Tuple2<Integer,String>, Tuple2<Integer,String>, Tuple3<Integer,String,String>>() { public Tuple3<Integer, String, String> join(Tuple2<Integer, String> table1, Tuple2<Integer, String> table2) throws Exception { // 左外连贯示意等号右边的信息会被蕴含 if(table2 == null){ return new Tuple3<Integer, String, String>(table1.f0,table1.f1,null); }else{ return new Tuple3<Integer, String, String>(table1.f0,table1.f1,table2.f1); } } }).print();System.out.println("***********************************");//右外连贯table1.rightOuterJoin(table2).where(0).equalTo(0) .with(new JoinFunction<Tuple2<Integer,String>, Tuple2<Integer,String>, Tuple3<Integer,String,String>>() { public Tuple3<Integer, String, String> join(Tuple2<Integer, String> table1, Tuple2<Integer, String> table2) throws Exception { //右外链接示意等号左边的表的信息会被蕴含 if(table1 == null){ return new Tuple3<Integer, String, String>(table2.f0,null,table2.f1); }else{ return new Tuple3<Integer, String, String>(table2.f0,table1.f1,table2.f1); } } }).print();System.out.println("***********************************");//全外连贯table1.fullOuterJoin(table2).where(0).equalTo(0).with(new JoinFunction<Tuple2<Integer,String>, Tuple2<Integer,String>, Tuple3<Integer,String,String>>() { public Tuple3<Integer, String, String> join(Tuple2<Integer, String> table1, Tuple2<Integer, String> table2) throws Exception { if(table1 == null){ return new Tuple3<Integer, String, String>(table2.f0,null,table2.f1); }else if(table2 == null){ return new Tuple3<Integer, String, String>(table1.f0,table1.f1,null); }else{ return new Tuple3<Integer, String, String>(table1.f0,table1.f1,table2.f1); } } }).print(); ...

October 9, 2020 · 3 min · jiezi

关于大数据:开始segmentfault之旅

明天是第一天开始记录本人的采坑心得。 之前始终是java后端开发，然而真正工作后开始接触flink大数据处理方面。之前有过很多flink开发的小坑，然而没有记录下来，所以当初筹备把本人的采坑之旅残缺记录下来，心愿大家能够多给意见和倡议。谢谢大家！

October 6, 2020 · 1 min · jiezi

关于大数据:Hadoop框架HDFS简介与Shell管理命令

本文源码：GitHub·点这里 || GitEE·点这里 一、HDFS根本概述1、HDFS形容大数据畛域始终面对的两大外围模块：数据存储，数据计算，HDFS作为最重要的大数据存储技术，具备高度的容错能力，稳固而且牢靠。HDFS(Hadoop-Distributed-File-System)，它是一个分布式文件系统，用于存储文件，通过目录树来定位文件;设计初衷是治理数成千盈百的服务器与磁盘，让应用程序像应用一般文件系统一样存储大规模的文件数据，适宜一次写入，屡次读出的场景，且不反对文件的批改，适宜做数据分析。 2、基础架构 HDFS具备主/从体系结构，有两个外围组件，NameNode与DataNode。 NameNode 负责文件系统的元数据（MetaData）治理，即文件路径名、数据块ID、存储地位等信息，并配置正本策略，解决客户端读写申请。 DataNode 执行文件数据的理论存储和读写操作，每个DataNode存储一部分文件数据块，文件整体散布存储在整个HDFS服务器集群中。 Client 客户端，文件切分上传HDFS的时候，Client将文件切分成一个一个的Block，而后进行上传;从NameNode获取文件的地位信息;与DataNode通信读取或者写入数据; Client通过一些命令来拜访或治理HDFS。 Secondary-NameNode 不是NameNode的热备，然而分担NameNode工作量，比方定期合并Fsimage和Edits，并推送给NameNode;在紧急情况下，可辅助复原NameNode。 3、高容错性 数据块多份复制存储的示意,文件/users/sameerp/data/part-0，复制备份设置为2，存储的block-ids别离为1、3；文件/users/sameerp/data/part-1，复制备份设置为3，存储的block-ids别离为2、4、5；任何单台服务器宕机后，每个数据块至多还存在一个备份服务存活，不会影响对文件的拜访，进步整体容错性。 HDFS中的文件在物理上是分块存储(Block)，块的大小能够通过参数dfs.blocksize来配置，块设置太小，会减少寻址工夫；块设置的太大，从磁盘传输数据的工夫会很慢，HDFS块的大小设置次要取决于磁盘传输速率。 二、根底Shell命令1、根底命令 查看Hadoop下相干Shell操作命令。 [root@hop01 hadoop2.7]# bin/hadoop fs[root@hop01 hadoop2.7]# bin/hdfs dfsdfs是fs的实现类 2、查看命令形容 [root@hop01 hadoop2.7]# hadoop fs -help ls3、递归创立目录 [root@hop01 hadoop2.7]# hadoop fs -mkdir -p /hopdir/myfile4、查看目录 [root@hop01 hadoop2.7]# hadoop fs -ls /[root@hop01 hadoop2.7]# hadoop fs -ls /hopdir5、剪贴文件 hadoop fs -moveFromLocal /opt/hopfile/java.txt /hopdir/myfile## 查看文件hadoop fs -ls /hopdir/myfile6、查看文件内容 ## 查看全副hadoop fs -cat /hopdir/myfile/java.txt## 查看开端hadoop fs -tail /hopdir/myfile/java.txt7、追加文件内容 ...

September 29, 2020 · 1 min · jiezi

关于大数据:MapReduce怎么优雅地实现全局排序

思考想到全局排序，是否第一想到的是，从map端收集数据，shuffle到reduce来，设置一个reduce，再对reduce中的数据排序，显然这样和单机器并没有什么区别，要晓得mapreduce框架默认是对key来排序的，当然也能够将value放到key下面来达到对value排序，最初在reduce时候对调回去，另外排序是针对雷同分区，即一个reduce来排序的，这样其实也不能充分运用到集群的并行，那么如何更优雅地实现全局排序呢？ 摘要hadoop中的排序分为局部排序，全局排序，辅助排序，二次排序等，本文次要介绍如何实现key全局排序，共有三种实现形式： 设置一个reduce利用自定义partition 将数据按程序分批次分流到多个分区利用框架自实现TotalOrderPartitioner 分区器来实现实现首先筹备一些输出数据：https://github.com/hulichao/b...，如下， /data/job/file.txt232654321575665223通过设置一 个reduce来实现全局排序利用一个reduce来实现全局排序，能够说不须要做什么特地的操作，mapper,reduce,driver实现如下： package com.hoult.mr.job;import org.apache.hadoop.io.IntWritable;import org.apache.hadoop.io.LongWritable;import org.apache.hadoop.io.Text;import org.apache.hadoop.mapreduce.Mapper;import java.io.IOException;public class JobMapper extends Mapper<LongWritable, Text, IntWritable, IntWritable> { @Override protected void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException { IntWritable intWritable = new IntWritable(Integer.parseInt(value.toString())); context.write(intWritable, intWritable); }}package com.hoult.mr.job;import org.apache.hadoop.io.IntWritable;import org.apache.hadoop.mapreduce.Reducer;import java.io.IOException;public class JobReducer extends Reducer<IntWritable, IntWritable, IntWritable, IntWritable> { private int index = 0;//全局排序计数器 @Override protected void reduce(IntWritable key, Iterable<IntWritable> values, Context context) throws IOException, InterruptedException { for (IntWritable value : values) context.write(new IntWritable(++index), value); }}package com.hoult.mr.job;import org.apache.hadoop.conf.Configured;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.*;import org.apache.hadoop.mapreduce.Job;import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;import org.apache.hadoop.util.Tool;import org.apache.hadoop.util.ToolRunner;public class JobDriver extends Configured implements Tool { @Override public int run(String[] args) throws Exception { if (args.length != 2) { System.err.println("input-path output-path"); System.exit(1); } Job job = Job.getInstance(getConf()); job.setJarByClass(JobDriver.class); FileInputFormat.addInputPath(job, new Path(args[0])); FileOutputFormat.setOutputPath(job, new Path(args[1])); job.setMapperClass(JobMapper.class); job.setReducerClass(JobReducer.class); job.setMapOutputKeyClass(IntWritable.class); job.setMapOutputValueClass(IntWritable.class); job.setOutputKeyClass(IntWritable.class); job.setOutputValueClass(NullWritable.class); //应用一个reduce来排序 job.setNumReduceTasks(1); job.setJobName("JobDriver"); return job.waitForCompletion(true) ? 0 : 1; } public static void main(String[] args)throws Exception{// int exitCode = ToolRunner.run(new JobDriver(), args); int exitCode = ToolRunner.run(new JobDriver(), new String[] {"data/job/", "data/job/output"}); System.exit(exitCode); }}//加了排序索引，最初输入一个文件，内容如下：1 22 63 154 225 266 327 328 549 9210 65011 65412 75613 595614 65223PS; 以上通过hadoop自带的ToolRunner工具来启动工作，后续代码波及到反复的不再列出，只针对差异性的代码。 ...

September 20, 2020 · 3 min · jiezi

关于大数据:HDFS主要流程

HDFS的几个典型的流程：客户端读HDFS文件流程、客户端写HDFS文件流程、客户端追加写HDFS文件流程、数据节点与名字节点交互流程以及HDFS HA切换流程等。 一、客户端读HDFS文件流程关上HDFS文件:HDFS客户端首先调用DistributedFileSystem.open()办法关上HDFS文件，这个办法在底层会调用ClientProtocol.open()办法，该办法会返回一个HdfsDataInputStream对象用于读取数据块。HdfsDataInputStream其实是一个DFSInputStream的装璜类，真正进行数据块读取操作的是DFSInputStream对象。从Namenode获取Datanode地址:在DFSInputStream的构造方法中，会调用ClientProtocol.getBlockLocations()办法向名字节点获取该HDFS文件起始地位数据块的地位信息。Namenode返回的数据块的存储地位是依照与客户端的间隔远近排序的，所以DFSInputStream能够抉择一个最优的Datanode节点，而后与这个节点建设数据连贯读取数据块。连贯到Datanode读取数据块:HDFS客户端通过调用DFSInputStream.read()办法从这个最优的Datanode读取数据块，数据会以数据包(packet)为单位从数据节点通过流式接口传送到客户端。当达到一个数据块的开端时，DFSInputStream就会再次调用ClientProtocol.getBlockLocations()获取文件下一个数据块的地位信息，并建设和这个新的数据块的最优节点之间的连贯，而后HDFS客户端就能够持续读取数据块了。敞开输出流:当客户端胜利实现文件读取后，会通过HdfsDataInputStream.close()办法敞开输出流。流程图如下： 客户端读取数据块时，很有可能存储这个数据块的数据节点出现异常，也就是无奈读取数据。呈现这种状况时，DFSInputStream会切换到另一个保留了这个数据块正本的数据节点而后读取数据。同时须要留神的是，数据块的应答包中不仅蕴含了数据，还蕴含了校验值。HDFS客户端接管到数据应答包时，会对数据进行校验，如果呈现校验谬误，也就是数据节点上的这个数据块正本呈现了损坏，HDFS客户端就会通过ClientProtocol.reportBadBlocks()向Namenode汇报这个损坏的数据块正本，同时DFSInputStream会尝试从其余的数据节点读取这个数据块。 二、客户端写HDFS文件流程创立文件: HDFS客户端写-一个 新的文件时,会首先调用DistributedFileSystem.create()办法在HDFS文件系统中创立一个新的空文件。这个办法在底层会通过调用ClientProtocol.create()办法告诉Namenode执行对应的操作, Namenode会首先在文件系统目录树中的指定门路下增加一个新的文件，而后将创立新文件的操作记录到editlog中。实现ClientProtocol.create()调用后, DistributedFileSystem.create()办法就会返回一个HdfsDataOutputStream对象,这个对象在底层包装了一个DFSOutputStream对象，真正执行写数据操作的其实是DFSOutputStream对象。建设数据流管道:获取了DFSOutputStream对象后，HDFS客户端就能够调用 DFSOutputStream.write()办法来写数据了。因为DistributedFileSystem.create()办法只是在文件系统目录树中创立了一个空文件，并没有申请任何数据块，所以DFSOutputStream会首先调用ClientProtocol.addBlock()向Namenode申请一个新的空数据块，addBlock()办法会返回一个LocatedBlock对象，这个对象保留了存储这个数据块的所有数据节点的地位信息。取得了数据流管道中所有数据节点的信息后，DFSOutputStream就能够建设数据流管道写数据块了。通过数据流管道写入数据: 胜利地建设数据流管道后，HDFS客户端就能够向数据流管道写数据了。写入DFSOutputStream中的数据会先被缓存在数据流中，之后这些数据会被切分成一个个数据包(packet)通过数据流管道发送到所有数据节点。通过数据流管道顺次写入数据节点的本地存储。每个数据包都有个确认包(ack)，确认包会逆序通过数据流管道回到输入流。输入流在确认了所有数据节点曾经写入这个数据包之后，就会从对应的缓存队列删除这个数据包。当客户端写满一个数据块之后，会调用addBlock()申请一个新的数据块，而后循环执行上述操作。敞开输出流并提交文件: 当HDFS客户端实现了整个文件中所有数据块的写操作之后，就能够调用close()办法敞开输入流，并调用ClientProtocol.complete()办法告诉Namenode提交这个文件中的所有数据块，也就实现了整个文件的写入流程。流程图如下： 对于Datanode，当 Datanode胜利地承受一个新的数据块时，Datanode会通过DatanodeProtocol.blockReceivedAndDeleted()办法向Namenode汇报，Namenode会更新内存中的数据块与数据节点的对应关系。 如果客户端在写文件时，数据流管道中的数据节点呈现故障，则输入流会进行如下操作来进行故障复原。 输入流中缓存的没有确认的数据包会重新加入发送队列，这种机制确保了数据节点呈现故障时不会失落任何数据，所有的数据都是通过确认的。输入流会通过调用ClientProtocol.updateBlockForPipeline()办法为数据块申请一个新的工夫戳，而后应用这个新的工夫戳从新建设数据流管道。这种机制保障了故障Datanode上的数据块的工夫戳会过期，而后在故障复原之后，因为数据块的工夫戳与Namenode元数据中的不匹配而被删除，保障了集群中所有数据块的正确性。故障数据节点会从输出流管道中删除，而后输入流会通过调用ClientProtocol.getAdditionalDatanode()办法告诉Namenode调配新的数据节点到数据流管道中。接下来输入流会将新调配的Datanode增加到数据流管道中，并应用新的工夫戳从新建设数据流管道。因为新增加的数据节点上并没有存储这个新的数据块，这时HDFS客户端会通过DataTransferProtocol告诉数据流管道中的一个Datanode复制这个数据块到新的Datanode上.数据流管道从新建设之后，输入流会调用ClientProtocol.updatePipeline()更新Namenode中的元数据。至此，一个残缺的故障复原流程就实现了，客户端能够失常实现后续的写操作了。三、Datanode启动、心跳以及执行名字节点指令流程Datanode启动后与 Namenode 的交互次要包含三个局部:①握手;②注册;③块汇报以 及缓存汇报。 Datanode启动时会首先通过DatanodeProtocol.versionRequest()获取Namenode的版本号以及存储信息等，而后Datanode会对Namenode的以后软件版本号和Datanode的以后软件、版本号进行比拟，确保它们是统一的。胜利地实现握手操作后，Datanode会通过DatanodeProtocol.register()办法向Namenode注册。Namenode接管到注册申请后，会判断以后Datanode的配置是否属于这个集群，它们之间的版本号是否统一。注册胜利之后，Datanode就须要将本地存储的所有数据块以及缓存的数据块上报到Namenode,Namenode会利用这些信息从新建设内存中数据块与Datanode之间的对应关系。至此，Datanode 就实现了启动的所有操作，之后就能够失常对外服务了。 Datanode胜利启动之后,须要定期向Namenode发送心跳,让Namenode晓得以后Datanode 处于活动状态可能对外服务。Namenode 会在Datanode 的心跳响应中携带名字节点指令，领导Datanode进行数据块的复制、删除以及复原等操作。 当Datanode胜利地增加了一个新的数据块或者删除了-一个已有的数据块时，须要通过 DatanodeProtocol.blockReceivedAndDeleted(办法向Namenode汇报。Namenode接管到这个汇 报之后，会更新Namenode内存中数据块与数据节点之间的对应关系。

September 16, 2020 · 1 min · jiezi

关于大数据:大数据下单集群如何做到2万规模

摘要：用户的多场景交融剖析的诉求不容许将集群进行拆分，不容许将数据分析业务割裂而导致业务模块之间失去关联，故华为开启了单集群2万节点规模摸索。7月9日，中国通信院在大数据产业峰会·成绩发布会上为通过大数据产品能力评测的产品颁发证书，华为云FusionInsight MRS以测试项全副满分的问题顺利通过评估，并胜利冲破单集群2万节点的超大规模，建立行业新标杆。 为了应答5G、IoT高速倒退，大数据技术在分布式批处理根底能力上进一步增强。FusionInsight MRS作为华为基于Hadoop生态的大数据产品，始终致力于超大规模单集群承载能力的摸索和实际，目标是当数据指数级增长时，华为自研的大数据产品能平滑的满足用户需要。随着社会数字化转型的减速，数据量激增超出了预期，与此同时，用户的多场景交融剖析的诉求不容许将集群进行拆分，不容许将数据分析业务割裂而导致业务模块之间失去关联。因而华为大数据研发团队开启了单集群2万节点规模摸索。 超大规模集群的技术痛点对于一个分布式系统来说，当集群规模由小变大当前，简略的问题都会变得异样简单。随着节点的增多，简略的心跳机制，也会让Master节点不堪重负。2W节点的FusionInsight MRS集群面临着诸多挑战： 1.如何实现面向多租户场景的批、流、交互式混合负载的高效调度，集群规模与解决能力的线性扩大、引擎之间资源波峰波谷错峰复用 数据的集中存储能够通过超大集群来无效解决，但数据如果仅仅是存着，不会产生价值，只有进行大量的剖析能力从数据中找到价值。通过跑批工作，生成固定的报表是大数据平台的惯例用法，数百P的数据如果仅仅用来跑批，无论是对数据还是对海量的计算资源都是一种节约；工夫就是金钱，工夫就是效率，数据T+0入湖，实时更新入湖，就是一直减速数据价值变现，超大规模集群应该能实现数据的T+0实时数据入湖，全量数据的批量剖析，数据分析师的交互式摸索剖析，确保平台的价值最大化 。如在一个大集群上，同时疾速的实现数据T+0的实时入湖，批剖析，还能面向大量分析师的即席查问要求，做到计算资源的隔离和共享，是调度零碎须要解决的一个重要问题。 2.如何面对存储、计算、治理方面的新挑战，冲破多个组件的瓶颈限度 计算方面：随着集群规模变大，YARN的ResourceManager可调度的资源变得更多，能够并行的工作更多，这对核心调度过程提出了更高的要求，如果调度速度跟不上，作业工作会在集群入口处沉积，而集群的计算资源无奈无效利用。 存储方面：随着存储容量的减少，HDFS在大规模集群上须要治理的文件对象增多，HDFS NameNode元数据量也会相应减少。社区尽管提供了NameNode联邦机制，但须要应用层感知不同NameNode的命名空间，应用和保护都会变得异样简单。除此之外，还很容易呈现各命名空间之间映射的数据量不平衡的问题。同时，随着数据量的减少，Hive元数据中的数据量急剧增长，对元数据库也会造成极大的压力，极易呈现所有的SQL语句都沉积在元数据查问环节造成阻塞。 运维治理方面：除了计算和存储面临的瓶颈问题，平台的运维能力，也会随着规模变大，遇到瓶颈问题。如零碎的监控零碎，当节点从5000变为20000的时候，每秒解决的监控指标会从每秒60万减少到200多万条。 3.如何晋升大规模集群的可靠性和运维能力，确保集群不停服 平台的可靠性始终是平台运维部门最关注的点，当集群承当了全团体的全量数据对立加工剖析之后，就意味着集群必须24小时永远在线，然而技术会一直倒退[Z(4] ，平台必须要确保零碎能够反对后续的更新与降级，以确保集群可面相将来继续演进，倒退。 另外，随着集群规模的减少，机房空间有余的问题将凸显进去。如果简略地将一个大集群跨机房部署，在带宽负载和可靠性上，都会面临比拟大的挑战。如何做到机房级的可靠性，对一个超大规模的集群也至关重要。 超大规模集群优化的实际过程针对以上各方面的挑战，FusionInsight MRS在3.0版本进行了系统性的优化。如果说当年从500到5000节点，次要是在代码级的优化，那么从5000到2W，仅凭代码级的优化曾经无奈达成，很多问题须要架构级的优化能力解决。 1.自研Superior超级调度器，解决超大规模调度效率和面向多租户场景的混合负载的问题 FusionInsight引入数据虚拟化引擎，在对立的大集群上提供了交互式查问的能力,解决了面向分析师的查问效率问题。为了撑持在超大集群上同时反对多样化的负载，在自研的Superior调度器上，实现了为租户同时调配保留资源与共享资源，租户独享保留资源的权利同时还满足了资源共享的需要。对于更重要的业务，则能够通过绑定固定资源池的形式，将一批固定的机器调配给某个租户，做到物理上的隔离。通过计算引擎和调度引擎的协同，真正做到了数据不出湖，在一个大平台上的业务闭环。 在多租户能力方面，随着租户越来越多，租户间的资源隔离成为用户的外围诉求。Hadoop社区提供了基于队列的计算资源隔离能力，基于Quota的存储资源阈值限度能力，然而在工作或者读写操作被调配到同一台主机上时，仍然会互相争抢资源。针对此场景，在MRS产品上提供了以下几种形式进行更加细粒度的隔离： 标签存储：给承载存储资源的DataNode打标签，在文件写入时指定标签，实现了最大水平的存储资源隔离。该个性能够有效应用于冷热数据存储和硬件资源异构的场景。多服务：在同一个集群中的不同主机资源上，部署多个同种服务，不同的利用可依据需要，应用各自的服务资源，并且相互之间互不烦扰。多实例：在同一个集群中的同一台主机资源上，独立部署同种服务的多个实例资源，以达到主机资源的充分利用，不与其它服务实例共享。例如：HBase多实例、Elasticsearch多实例、Redis多实例等。2.技术攻坚，冲破计算、存储、治理等各方面的瓶颈 在计算工作的调度效率方面，通过专利调度算法进行优化，将一维的调度转换为二维调度，实现了绝对开源调度器在效率上数倍晋升。在理论的大规模集群生产环境下，针对自研Superior和开源Capacity性能比照： 同步调度状况下，Superior比Capacity快30倍异步调度状况下，Superior比Capacity快2倍同时通过对2W集群的深度优化，FusionInsight MRS 3.0版本的Superior能够达到调度35w/s个Container的调度速率，齐全超出了大规模集群在调度速率上的用户预期，并且集群资源利用率达到98%以上，超过开源Capacity的能力近一倍，为大规模集群的安稳商用奠定了松软的根底。 下图是别离在Superior和Capacity下对于“资源利用率”的监控视图：能够看出Superior近乎100%的资源使用率，而Capacity下资源无奈失去充分利用。 Superior资源利用率 Capacity资源利用率 在存储方面，Hadoop社区为解决HDFS在文件对象治理上的瓶颈，推出了联邦解决方案。然而大量不同命名空间的引入，间接导致下层业务在开发、治理、保护上复杂度回升。为解决这一问题，社区又推出了Router Based Federation个性，因为在NameNode之上加了一层Router进行交互，导致性能降落。 针对以上问题，FusionInsight MRS对产品计划做了如下优化： 通过在大集群生产环境中辨认要害瓶颈，FusionInsight MRS利用合并单次读写流程中的交互次数、应用改进的数据通信压缩算法等技术计划，将性能降落管制在4%以内。为解决不同命名空间之间数据不平衡的问题，FusionInsight MRS利用DataMovementTool主动平衡不同命名空间之间的数据，大大降低了集群保护老本。随着数据量的减少，Hive的元数据在面对海量表/分区的时候，也面临着十分大的瓶颈。尽管Hive的社区推出了Metastore Cache的解决方案，但并未解决多个Metastore之间的缓存一致性的问题，导致此计划无奈在大规模的集群上规模商用。FusionInsight MRS通过引入分布式缓存Redis作为代替计划，联合分布式锁、缓存黑白名单机制、缓存生命周期治理等技术手段加强了Metastore Cache的可用性。 在运维治理面方面，当集群规模增长到2W节点后，运维压力陡然减少： 零碎须要采集的监控指标数量也从原来的每秒采集60W+条数据，增长到200W+条告警并发解决从原来的200条/s增长到1000条/s配置管理的总条目数从50万增长到200多万FusionInsight MRS原有架构中主备模式的监控、告警、配置、元数据存储模块，因为数据量的暴涨受到了微小的性能挑战，为解决这一问题，新版本利用Flink、HBase、Hadoop、Elasticsearch等成熟的分布式组件技术，将原来的粗放主从模式调整成了可弹性伸缩的分布式模式，胜利解决了运维治理面临的难题，并且为后续运维数据的二次价值开掘打下了根底。 3.通过滚动降级/补丁、工作级“断点续传”、跨AZ高可用等部署能力，保障平台继续稳固运行 滚动降级/补丁：FusionInsight从2.7版本开始反对滚动降级性能，实现了平台降级/补丁等操作的业务无感知。但随着工夫的倒退 ，社区能力却不反对滚动降级，如Hadoop2到Hadoop3的大版本升级这意味着很多超大集群不得不始终停留在老版本而无奈降级，当然这是业务无奈承受的。FusionInsight MRS通过对社区接口的兼容性解决，胜利实现了Hadoop大版本间的滚动升极，并在2020年Q2实现了1W+节点集群规模的滚动降级。在FusionInsight的客户中，滚动升级成了500+规模集群的必备能力。 工作级“断点续传”：在大规模集群上，继续运行着一些超大工作，动辄蕴含几十万个Container，这类工作往往运行工夫长，两头一旦呈现个别故障，有可能导致工作需从新执行，造成大量的计算资源白白浪费。 FusionInsight MRS提供了多种机制保障工作的牢靠运行，例如： 存储上提供感知AZ的文件存储策略，将文件本身及其正本别离搁置在不同的AZ上，用户发动读写操作时，优先在本AZ内寻找资源，只有在AZ故障的极其场景下，才会呈现跨AZ的网络读写流量。计算上提供感知AZ的任务调度机制，将用户提交的工作充沛调配在同一个AZ内实现，防止同一个工作的不同计算单元之间耗费网络资源。通过以上的存储块搁置策略和计算工作的本地化调度，还可实现单集群跨AZ的高可用，单AZ故障的时候，外围数据和计算工作不受影响。 【结束语】FusionInsight MRS 单集群21000节点在2020年7月获信通院颁发大数据产品能力评测证书，成为业界第一个单集群冲破2W节点的商用大数据平台，建立行业新标杆。将来，FusionInsight MRS将继续深刻大数据技术的摸索和钻研，在大集群技术的根底上进一步实现存算拆散，通过对立的元数据和平安治理，实现数算拆散（数据+元数据和计算拆散），从而实现数据在更大范畴的共享，进而实现一份数据，多个计算集群的灵便部署和弹性伸缩，通过平滑扩大的架构，可反对10万级，甚至百万级别的集群规模，一直适应企业大数据利用多场景交融的外围诉求。 将来架构演进方向 十多年来FusionInsight 致力于为寰球60+国家地区、3000+政企客户构建企业级智能数据湖，联合平台+生态策略，与800+商业合作伙伴 ，广泛应用于金融、运营商、政府、能源、医疗、制作、交通等多个行业，在政企数字化转型中，开释数据价值，助力政企客户业务高速增长。MRS源于凋谢的大数据生态，叠加了企业级的要害能力，既放弃了开放性，又给客户提供了企业级交融大数据平台，帮忙客户实现T+0数据入湖，一站式交融剖析，让数据“慧”谈话。 点击关注，第一工夫理解华为云陈腐技术~ ...

September 16, 2020 · 1 min · jiezi

关于大数据:数据湖架构为什么需要湖加速

简介： 湖减速即为数据湖减速，是指在数据湖架构中，为了对立反对各种计算，对数据湖存储提供适配反对，进行优化和缓存减速的中间层技术。那么为什么须要湖减速？数据湖如何实现“减速”？本文将从三个方面来介绍湖减速背地的起因，分享阿里云在湖减速上的实践经验和技术计划。 在开源大数据畛域，存储/计算拆散曾经成为共识和规范做法，数据湖架构成为大数据平台的首要抉择。基于这一范式，大数据架构师须要思考三件事件： 第一，抉择什么样的存储系统做数据湖(湖存储)？第二，计算和存储拆散后，呈现了性能瓶颈，计算如何减速和优化(湖减速)？第三，针对须要的计算场景，抉择什么样的计算引擎(湖计算)？ 湖存储能够基于咱们相熟的HDFS，在公共云上也能够选择对象存储，例如阿里云OSS。在公共云上，基于对象存储构建数据湖是目前业界最支流的做法，咱们这里重点探讨第二个问题，联合阿里云上的EMR JindoFS优化和实际，看看数据湖怎么玩“减速”。 湖减速在数据湖架构里，湖存储（HDFS，阿里云OSS）和湖计算（Spark，Presto）都比较清楚。那么什么是湖减速？大家无妨搜寻一下…（根本没有间接的答案）。湖减速是阿里云EMR同学在外部提出来的，顾名思义，湖减速即为数据湖减速，是指在数据湖架构中，为了对立反对各种计算，对数据湖存储提供适配反对，进行优化和缓存减速的中间层技术。这外面呈现较早的社区计划应该是Alluxio，Hadoop社区有S3A Guard，AWS有EMRFS，都适配和反对AWS S3，Snowflake在计算侧有SSD缓存，Databricks有DBIO/DBFS，阿里云有EMR JindoFS，大体都能够归为此类技术。 那么为什么须要湖减速呢？这和数据湖架构分层，以及相干技术演进具备很大关系。接下来，咱们从三个方面的介绍来寻找答案。别离是：根底版，要适配；标配版，做缓存；高配版，深度定制。JindoFS同时涵盖这三个档次，实现数据湖减速场景全笼罩。 根底版：适配对象存储以Hadoop为根底的大数据和在AWS上以EC2/S3为代表的云计算，在它们倒退的晚期，更像是在平行的两个世界。等到EMR产品呈现后，怎么让大数据计算（最后次要是MapReduce）对接S3，才成为一个实在的技术命题。对接S3、OSS对象存储，大数据首先就要适配对象接口。Hadoop生态的开源大数据引擎，比方Hive和Spark，过来次要是反对HDFS，以Hadoop Compatible File System（HCFS）接口适配、并反对其余存储系统。机器学习生态（Python）以POSIX接口和本地文件系统为主，像TensorFlow这种深度学习框架当然也反对间接应用HDFS 接口。对象存储产品提供REST API，在次要开发语言上提供封装好的SDK，但都是对象存储语义的，因而上述这些风行的计算框架要用，必须加以适配，转换成HCFS接口或者反对POSIX。这也是为什么随着云计算的风行，适配和反对云上对象存储产品成为Hadoop社区开发的一个热点，比方S3A FileSytem。阿里云EMR团队则鼎力打造JindoFS，全面反对阿里云OSS并提供减速优化。如何高效地适配，并不是设计模式上减少一层接口转换那么简略，做好的话须要了解两种零碎（对象存储和文件系统）背地的重要差别。咱们略微开展一下： 第一，海量规模。 对象存储提供海量低成本存储，相比文件系统（比方HDFS），阿里云OSS更被用户认为可有限扩大。同时随着各种BI技术和AI技术的风行和遍及，开掘数据的价值变得切实可行，用户便偏向于往数据湖（阿里云OSS）贮存越来越多不同类型的数据，如图像、语音、日志等等。这在适配层面带来的挑战就是，须要解决比传统文件系统要大许多的数据量和文件数量。千万级文件数的超大目录不足为奇，甚至蕴含大量的小文件，面对这种目录，个别的适配操作就失灵了，不是OOM就是hang在那儿，基本就不可用。JindoFS一路走来积攒了很多教训，咱们对大目录的listing操作和du/count这种统计操作从内存应用和充沛并发进行了深度优化，目前达到的成果是，千万文件数超大目录，listing操作比社区版本快1倍，du/count快21%，整体体现更为稳固牢靠。 第二，文件和对象的映射关系。 对象存储提供key到blob对象的映射，这个key的名字空间是扁平的，自身并不具备文件系统那样的层次性，因而只能在适配层模仿文件/目录这种层次结构。正是因为要靠模仿，而不是原生反对，一些要害的文件/目录操作代价低廉，这外面最为出名的就是rename了。文件rename或者mv操作，在文件系统外面只是须要把该文件的inode在目录树上移动下地位即可，一个原子操作；然而在对象存储上，往往受限于外部的实现形式和提供进去的标准接口，适配器个别须要先copy该对象到新地位，而后再把老对象delete掉，用两个独立的步骤和API调用。对目录进行rename操作则更为简单，波及到该目录下的所有文件的rename，而每一个都是上述的copy+delete；如果目录档次很深，这个rename操作还须要递归嵌套，波及到数量微小的客户端调用次数。对象的copy通常跟它的size相干，在很多产品上还是个慢活，能够说是雪上加霜。阿里云OSS在这方面做了很多优化，提供Fast Copy能力，JindoFS充分利用这些优化反对，联合客户端并发，在百万级大目录rename操作上，性能比社区版本靠近快3X。 第三，一致性。 为了谋求超大并发，不少对象存储产品提供的是最终一致性（S3），而不是文件系统常见的强一致性语义。这带来的影响就是，举个栗子，程序明明往一个目录外面刚刚写好了10个文件，后果随后去list，可能只是局部文件可见。这个不是性能问题，而是正确性了，因而在适配层为了满足大数据计算的需要，Hadoop社区在S3A适配上花了很大力量解决应答这种问题，AWS本人也相似提供了EMRFS，反对ConsistentView。阿里云OSS提供了强一致性，JindoFS基于这一个性大大简化，用户和计算框架应用起来也毋庸放心相似的一致性和正确性问题。 第四，原子性。 对象存储本身没有目录概念，目录是通过适配层模仿进去的。对一个目录的操作就转化为对该目录下所有子目录和文件的客户端屡次调用操作，因而即便是每次对象调用操作是原子的，但对于用户来说，对这个目录的操作并不能真正做到原子性。举个例子，删除目录，对其中任何一个子目录或文件的删除操作失败（蕴含重试），哪怕其余文件删除都胜利了，这个目录删除操作整体上还是失败。这种状况下该怎么办？通常只能留下一个处于两头失败状态的目录。JindoFS在适配这些目录操作（rename，copy，delete and etc）的时候，联合阿里云 OSS 的扩大和优化反对，在客户端尽可能重试或者回滚，可能很好地连接数据湖各种计算，在pipeline 上下游之间保障正确处理。 第五，冲破限度。 对象存储产品是独立演变倒退的，少不了会有本人的一些独门秘籍，这种个性要充分利用起来可能就得冲破HCFS形象接口的限度。这里重点谈下对象存储的高级个性Concurrent MultiPartUpload (CMPU)，该个性容许程序依照分片并发上传part的形式高效写入一个大对象，应用起来有两个益处，一个是能够依照并发甚至是分布式的形式写入一个大对象，实现高吞吐，充分发挥对象存储的劣势；另外一个是，所有parts都是先写入到一个staging区域的，直到complete的时候整个对象才在指标地位呈现。利用阿里云OSS这个高级个性，JindoFS开发了一个针对MapReduce模型的Job Committer，用于Hadoop，Spark 和相似框架，其实现机制是各个工作先将计算结果依照part写入到长期地位，而后作业commit的时候再complete这些后果对象到最终地位，实现毋庸rename的成果。咱们在Flinkfile sink connector反对上也同样往计算层透出这方面的额定接口，利用这个个性反对了Exactly-Once的语义。 标配版：缓存减速数据湖架构对大数据计算的另外一个影响是存/算拆散。存储和计算拆散，使得存储和计算在架构上解耦，存储朝着大容量低成本规模化供给，计算则向着弹性伸缩，丰富性和多样化向前倒退，在整体上有利于专业化分工和大家把技术做深，客户价值也能够实现最大化。然而这种拆散架构带来一个重要问题就是，存储带宽的供给在一些状况下可能会跟计算对存储带宽的需要不相适应。计算要跨网络拜访存储，数据本地性隐没，拜访带宽整体上会受限于这个网络；更重要的是，在数据湖理念下，多种计算，越来越多的计算要同时拜访数据，会竞争这个带宽，最终使得带宽供需失衡。咱们在大量的实际中发现，同一个OSS bucket，Hive/Spark数仓要进行ETL，Presto要交互式剖析，机器学习也要抽取训练数据，这个在数据湖时代之前不可设想，那个时候兴许最多的就是MapReduce作业了。这些多样化的计算，对数据拜访性能和吞吐的需要却不遑多让甚至是变本加厉。常驻的集群心愿实现更多的计算；弹性伸缩的集群则心愿尽快实现作业，把大量节点给开释掉节省成本；像Presto这种交互式剖析业务方心愿是越快越好，稳固亚秒级返回不受任何其余计算影响；而GPU训练程序则是冀望数据齐全本地化一样的极大吞吐。像这种场面该如何破呢？有限地减少存储侧的吞吐是不事实的，因为整体上受限于和计算集群之间的网络。无效地保障丰盛的计算对存储带宽的需要，业界早已给出的答案是计算侧的缓存。Alluxio始终在做这方面的事件，JindoFS外围定位是数据湖减速层，其思路也同出一辙。上面是它在缓存场景上的架构图。 JindoFS在对阿里云OSS适配优化的同时，提供分布式缓存和计算减速，刚刚写出去的和反复拜访的数据能够缓存在本地设施上，包含HDD，SSD和内存，咱们都别离专门优化过。这种缓存减速是对用户通明的，自身并不需要计算额定的感知和作业批改，在应用上只须要在OSS适配的根底上关上一个配置开关，开启数据缓存。叠加咱们在适配上的优化，跟业界某开源缓存计划相比，咱们在多个计算场景上都具备显著的性能当先劣势。基于磁盘缓存，受害于咱们可能更好地balance多块磁盘负载和高效精细化的缓存块治理，咱们用TPC-DS 1TB进行比照测试，SparkSQL性能快27%；Presto大幅当先93%；在HiveETL场景上，性能当先42%。JindoFS 的 FUSE反对齐全采纳 native 代码开发而没有 JVM 的累赘，基于SSD缓存，咱们用TensorFlow程序通过JindoFuse来读取JindoFS上缓存的OSS数据来做训练，相较该开源计划性能快40%。 在数据湖架构下在计算侧部署缓存设施引入缓存，能够实现计算减速的益处，计算效率的晋升则意味着更少的弹性计算资源应用和老本收入，但另一方面毋庸讳言也会给用户带来额定的缓存老本和累赘。如何掂量这个老本和收益，确定是否引入缓存，须要结合实际的计算场景进行测试评估，不能一概而论。 高配版：深度定制，本人管理文件元数据咱们在JindoFS上优化好OSS适配，把Jindo分布式缓存性能做到效力最大化，能满足绝大多数大规模剖析和机器学习训练这些计算。现有的JindoFS大量部署和应用表明，无论Hive/Spark/Impala这种数仓作业，Presto交互式剖析，还是TensorFlow训练，咱们都能够在计算侧通过应用阿里云缓存定制机型，来达到多种计算高效拜访OSS数据湖的吞吐要求。可是故事并没有完，数据湖的架构决定了计算上的开放性和更加多样性，下面这些计算可能是最次要的，但并不是全副，JindoFS在设计之初就心愿实现一套部署，即能笼罩各种次要场景。一个典型状况是，有不少用户心愿JindoFS可能齐全代替HDFS，而不只是Hive/Spark够用就能够了，用户也不心愿在数据湖架构下还要混合应用其余存储系统。整顿一下大略有上面几种状况须要咱们进一步思考。 第一、下面探讨对象存储适配的时候咱们提到，一些文件/目录操作的原子性需求在实质上是解决不了的，比方文件的rename，目录的copy，rename和delete。彻底解决这些问题，齐全满足文件系统语义，基本上须要本人实现文件元数据管理，像HDFS NameNode那样。 第二、HDFS有不少比拟高级的个性和接口，比方反对truncate，append，concat，hsync，snapshot和Xattributes。像HBase依赖hsync/snapshot，Flink依赖truncate。数据湖架构的开放性也决定了还会有更多的引擎要对接上来，对这些高级接口有更多需要。 第三、HDFS重度用户心愿可能平迁上云，或者在存储计划抉择上进行微调，原有基于HDFS的利用，运维和治理依然可能持续应用。在性能上提供Xattributes反对，文件权限反对，Ranger集成反对，甚至是auditlog反对；在性能上心愿不低于HDFS，最好比HDFS还好，还不须要对NameNode调优。为了也可能享受到数据湖架构带来的各种益处，该如何帮忙这类用户基于OSS进行架构降级呢？ 第四、为了冲破S3这类对象存储产品的局限，大数据业界也在针对数据湖深度定制新的数据存储格局，比方Delta，Hudi，和Iceberg。如何兼容反对和无力优化这类格局，也须要进一步思考。 基于这些因素，咱们进一步开发和推出JindoFS block模式，在OSS对象存储的根底上针对大数据计算进行深度定制，依然提供规范的HCFS接口，因为咱们深信，即便同样走深度定制路线，遵循现有规范与应用习惯对用户和计算引擎来说更加容易推广和应用，也更加合乎湖减速的定位和使命。JindoFS block模式对标HDFS，不同的是采取云原生的架构，依靠云平台咱们做了大量简化，使得整个零碎具备弹性，轻量和易于运维的特点和劣势。 如上图示，是JindoFS在block模式下的零碎架构，整体上重用了JindoFS缓存零碎。在这种模式下，文件数据是分块寄存在OSS上，保障牢靠和可用；同时借助于本地集群上的缓存备份，能够实现缓存减速。文件元数据异步写入到阿里云OTS数据库避免本地误操作，同时不便JindoFS集群重建复原；元数据在失常读写时走本地RocksDB，内存做LRU缓存，因而撑持的文件数在亿级；联合元数据服务的文件/目录级别细粒度锁实现，JindoFS在大规模高并发作业顶峰的时候体现比HDFS更稳固，吞吐也更高。咱们用HDFS NNBench做并发测试，对于最要害的open和create操作，JindoFS的IOPS比HDFS高60%。在千万级超大目录测试上，文件listing操作比HDFS快130%；文件统计du/count操作比HDFS快1X。借助于分布式Raft协定，JindoFS反对HA和多namespaces，整体上部署和保护比HDFS简化太多。在IO吞吐上，因为除了本地磁盘，还能够同时应用OSS带宽来读，因而在同样的集群配置下用DFSIO实测下来，读吞吐JindoFS比HDFS快33%。 JindoFS在湖减速整体解决方案上进一步反对block模式，为咱们拓宽数据湖应用场景和反对更多的引擎带来更大的设想空间。目前咱们曾经反对不少客户应用HBase，为了受害于这种存/算拆散的架构同时借助于本地治理的存储设备进行缓存减速，咱们也在摸索将更多的开源引擎对接上来。比方像Kafka，Kudu甚至OLAP新贵ClickHouse，能不能让这些引擎专一在它们的场景上，将它们从坏盘解决和如何伸缩这类事件上彻底解放出来。本来一些保持应用HDFS的客户也被block模式这种轻运维，有弹性，低成本和高性能的劣势吸引，通过这种形式也转到数据湖架构上来。如同对OSS的适配反对和缓存模式，JindoFS这种新模式依然提供齐全兼容的HCFS和FUSE反对，大量的数据湖引擎在应用上并不需要减少额定的累赘。 总结行文至此，咱们做个回顾和总结。基于数据湖对大数据平台进行架构降级是业界显著趋势，数据湖架构包含湖存储、湖减速和湖剖析，在阿里云上咱们通过 JindoFS 针对各种场景提供多种数据湖减速解决方案。阿里云推出的专门反对数据湖治理的Data Lake Formation，可全面反对数据湖。 ...

September 15, 2020 · 1 min · jiezi

关于大数据:大数据简介技术体系分类整理

简介： 大数据是指无奈在肯定工夫范畴内用惯例软件工具进行捕获、治理和解决的数据汇合，是须要新解决模式能力具备更强的决策力、洞察发现力和流程优化能力的海量、高增长率和多样化的信息资产。大数据技术则次要用来解决海量数据的存储和剖析。 一、大数据简介1、根底概念大数据是指无奈在肯定工夫范畴内用惯例软件工具进行捕获、治理和解决的数据汇合，是须要新解决模式能力具备更强的决策力、洞察发现力和流程优化能力的海量、高增长率和多样化的信息资产。大数据技术则次要用来解决海量数据的存储和剖析。 2、特点剖析大数据的5V特点（IBM提出）：Volume（大量）、Velocity（高速）、Variety（多样）、Value（低价值密度）、Veracity（真实性）。 3、倒退过程Google在2004年前后发表的三篇论文，别离是文件系统GFS、计算框架MapReduce、NoSQL数据库系统BigTable。海量数据文件，剖析计算，并存储，确立了大数据的基本原理和思路。 蠢才程序员DougCutting，也是Lucene、Nutch我的项目发起人。依据Google论文原理初步实现相似GFS和MapReduce的性能，起初倒退成为赫赫有名的Hadoop。 再起初，Hadoop通过高速的倒退，曾经造成一个生态体系，基于Hadoop之上，有实时计算，离线计算，NoSQL存储，数据分析，机器学习等一系列内容。 从这一系列事件倒退看技术法则：Google业务实际中创造性的提出论文作为根底，业务的成长和需要，迫使技术一直更新换代。所以业务是技术一直倒退的要害。 二、Hadoop框架1、Hadoop简介留神这里基于Hadoop2.X版本形容。后续如果没有特地阐明，都是2.7版本。 Hadoop是一个由Apache基金会所开发的分布式系统基础架构； 提供海量的数据存储能力，和剖析计算能力； 作为Apache的顶级我的项目，蕴含泛滥子项目是一个生态圈； 2、框架特点可靠性：Hadoop按位存储和存储多个数据正本，提供牢靠服务； 扩展性：Hadoop利用计算机集群调配数据并实现计算工作，能够不便地扩大到数以千计的节点中； 高效性：基于MapReduce思维，为海量的数据提供高效的并行计算； 容错性：主动保留数据的多个正本，并且可能主动将失败的工作重新分配； 3、组成构造HDFS存储 NameNode存储文件相干的元数据，例如：文件名，文件目录，创立工夫，权限正本数等。 DataNode文件系统存储文件块数据，以及和数据块ID的映射关系。 Yarn调度 负责资源管理和作业调度，将零碎资源分配给在Hadoop集群中运行的各种应用程序，并调度要在不同集群节点上执行的工作。 MapReduce计算 MapReduce将计算过程分为两个阶段：Map阶段并行处理输出数据，Reduce阶段对Map后果进行汇总。 三、大数据技术栈 1、Kafka中间件开源组织： Apache软件 利用场景： Kafka是一种高吞吐量的分布式公布订阅音讯零碎，通过磁盘数据结构提供音讯的长久化，这种构造对于即便数以TB的音讯存储也可能放弃长时间的稳定性能。高吞吐量：即便是十分一般的硬件Kafka也能够反对每秒数百万的音讯。反对通过Kafka服务器和消费机集群来分区音讯。反对Hadoop并行数据加载。 2、Flume日志零碎开源组织： Cloudera公司 利用场景： Flume是Cloudera提供的一个高可用的，高牢靠的，分布式的海量日志采集、聚合和传输的零碎，Flume反对在日志零碎中定制各类数据发送方，用于收集数据；同时，Flume提供对数据进行简略解决，并写到各种数据接受方（可定制）的能力。 3、Sqoop同步工具开源组织： Apache软件 利用场景： Sqoop是一款开源的工具，次要用于在Hadoop、Hive与传统的数据库例如：MySql间进行数据的传递，能够将一个关系型数据库（例如：MySQL，Oracle 等）中的数据导进到Hadoop的HDFS中，也能够将HDFS的数据导进到关系型数据库中。 4、HBase数据库开源组织： Apache软件 利用场景： HBase是一个分布式的、面向列的开源数据库，HBase在Hadoop之上提供了相似于Bigtable的能力。HBase是Apache的Hadoop我的项目的子项目。HBase不同于个别的关系数据库，它是一个适宜于非结构化数据存储的数据库，并且基于列的而不是基于行的存储模式。 5、Storm实时计算开源组织： Apache软件 利用场景： Storm用于实时计算，对数据流做间断查问，在计算时就将后果以流的模式输入给用户。Storm绝对简略，能够与任何编程语言一起应用。 6、Spark计算引擎开源组织： Apache软件 利用场景： Spark是专为大规模数据处理而设计的疾速通用的计算引擎，领有Hadoop的MapReduce所具备的长处；但不同于MapReduce的是——Job两头输入后果能够保留在内存中，从而不再须要读写HDFS，因而Spark能更好地实用于数据挖掘与机器学习等须要迭代的MapReduce的算法。Spark是在Scala 语言中实现的，它将Scala用作其应用程序框架。 7、R语言开源组织： 微软公司 利用场景： R是用于统计分析、绘图的语言和操作环境。R是属于GNU零碎的一个自在、收费、源代码凋谢的软件，它是一个用于统计计算和统计制图的优良工具。 8、Hive数仓工具开源组织： 脸书公司 利用场景： hive是基于Hadoop的一个数据仓库工具，用来进行数据提取、转化、加载，这是一种能够存储、查问和剖析存储在Hadoop中的大规模数据的机制。hive数据仓库工具能将结构化的数据文件映射为一张数据库表，并提供SQL查问性能，能将SQL语句转变成MapReduce工作来执行。 9、Oozie组件开源组织： Apache软件 利用场景： Oozie是一个治理Hdoop作业（job）的工作流程调度管理系统。 10、Azkaban组件开源组织： Linkedin公司 利用场景： ...

September 15, 2020 · 1 min · jiezi

关于大数据:大数据简介技术体系分类整理

本文源码：GitHub·点这里 || GitEE·点这里 一、大数据简介1、根底概念大数据是指无奈在肯定工夫范畴内用惯例软件工具进行捕获、治理和解决的数据汇合，是须要新解决模式能力具备更强的决策力、洞察发现力和流程优化能力的海量、高增长率和多样化的信息资产。大数据技术则次要用来解决海量数据的存储和剖析。 2、特点剖析大数据的5V特点（IBM提出）：Volume（大量）、Velocity（高速）、Variety（多样）、Value（低价值密度）、Veracity（真实性）。 3、倒退过程Google在2004年前后发表的三篇论文，别离是文件系统GFS、计算框架MapReduce、NoSQL数据库系统BigTable。海量数据文件，剖析计算，并存储，确立了大数据的基本原理和思路。 蠢才程序员DougCutting，也是Lucene、Nutch我的项目发起人。依据Google论文原理初步实现相似GFS和MapReduce的性能，起初倒退成为赫赫有名的Hadoop。 再起初，Hadoop通过高速的倒退，曾经造成一个生态体系，基于Hadoop之上，有实时计算，离线计算，NoSQL存储，数据分析，机器学习等一系列内容。 从这一系列事件倒退看技术法则：Google业务实际中创造性的提出论文作为根底，业务的成长和需要，迫使技术一直更新换代。所以业务是技术一直倒退的要害。 二、Hadoop框架1、Hadoop简介留神这里基于Hadoop2.X版本形容。后续如果没有特地阐明，都是2.7版本。 Hadoop是一个由Apache基金会所开发的分布式系统基础架构； 提供海量的数据存储能力，和剖析计算能力； 作为Apache的顶级我的项目，蕴含泛滥子项目是一个生态圈； 2、框架特点可靠性：Hadoop按位存储和存储多个数据正本，提供牢靠服务； 扩展性：Hadoop利用计算机集群调配数据并实现计算工作，能够不便地扩大到数以千计的节点中； 高效性：基于MapReduce思维，为海量的数据提供高效的并行计算； 容错性：主动保留数据的多个正本，并且可能主动将失败的工作重新分配； 3、组成构造HDFS存储 NameNode存储文件相干的元数据，例如：文件名，文件目录，创立工夫，权限正本数等。 DataNode文件系统存储文件块数据，以及和数据块ID的映射关系。 Yarn调度 负责资源管理和作业调度，将零碎资源分配给在Hadoop集群中运行的各种应用程序，并调度要在不同集群节点上执行的工作。 MapReduce计算 MapReduce将计算过程分为两个阶段：Map阶段并行处理输出数据，Reduce阶段对Map后果进行汇总。 三、大数据技术栈 1、Kafka中间件开源组织： Apache软件 利用场景： Kafka是一种高吞吐量的分布式公布订阅音讯零碎，通过磁盘数据结构提供音讯的长久化，这种构造对于即便数以TB的音讯存储也可能放弃长时间的稳定性能。高吞吐量：即便是十分一般的硬件Kafka也能够反对每秒数百万的音讯。反对通过Kafka服务器和消费机集群来分区音讯。反对Hadoop并行数据加载。 2、Flume日志零碎开源组织： Cloudera公司 利用场景： Flume是Cloudera提供的一个高可用的，高牢靠的，分布式的海量日志采集、聚合和传输的零碎，Flume反对在日志零碎中定制各类数据发送方，用于收集数据；同时，Flume提供对数据进行简略解决，并写到各种数据接受方（可定制）的能力。 3、Sqoop同步工具开源组织： Apache软件 利用场景： Sqoop是一款开源的工具，次要用于在Hadoop、Hive与传统的数据库例如：MySql间进行数据的传递，能够将一个关系型数据库（例如：MySQL，Oracle 等）中的数据导进到Hadoop的HDFS中，也能够将HDFS的数据导进到关系型数据库中。 4、HBase数据库开源组织： Apache软件 利用场景： HBase是一个分布式的、面向列的开源数据库，HBase在Hadoop之上提供了相似于Bigtable的能力。HBase是Apache的Hadoop我的项目的子项目。HBase不同于个别的关系数据库，它是一个适宜于非结构化数据存储的数据库，并且基于列的而不是基于行的存储模式。 5、Storm实时计算开源组织： Apache软件 利用场景： Storm用于实时计算，对数据流做间断查问，在计算时就将后果以流的模式输入给用户。Storm绝对简略，能够与任何编程语言一起应用。 6、Spark计算引擎开源组织： Apache软件 利用场景： Spark是专为大规模数据处理而设计的疾速通用的计算引擎，领有Hadoop的MapReduce所具备的长处；但不同于MapReduce的是——Job两头输入后果能够保留在内存中，从而不再须要读写HDFS，因而Spark能更好地实用于数据挖掘与机器学习等须要迭代的MapReduce的算法。Spark是在Scala 语言中实现的，它将Scala用作其应用程序框架。 7、R语言开源组织： 微软公司 利用场景： R是用于统计分析、绘图的语言和操作环境。R是属于GNU零碎的一个自在、收费、源代码凋谢的软件，它是一个用于统计计算和统计制图的优良工具。 8、Hive数仓工具开源组织： 脸书公司 利用场景： hive是基于Hadoop的一个数据仓库工具，用来进行数据提取、转化、加载，这是一种能够存储、查问和剖析存储在Hadoop中的大规模数据的机制。hive数据仓库工具能将结构化的数据文件映射为一张数据库表，并提供SQL查问性能，能将SQL语句转变成MapReduce工作来执行。 9、Oozie组件开源组织： Apache软件 利用场景： Oozie是一个治理Hdoop作业（job）的工作流程调度管理系统。 10、Azkaban组件开源组织： Linkedin公司 ...

September 15, 2020 · 1 min · jiezi

关于大数据:Hbase常用基础命令

Hbase表构造 1.进入Hbase shell >./bin/hbase shell2.查看以后操作用户 > whoami3.创立一个表 // 表名 列族1 列族2> create 'Rumenz','user','userInfo'4.查看数据库的表 > list5.增加数据 // 表名 rowkey 列族:字段名 值> put 'Rumenz','001','user:name','入门小站'> put 'Rumenz','001','user:type','1'6.查问记录行数 > count 'Rumenz'7.通过Row key查问记录 // 表名 Row key> get 'Rumenz','001'8.通过Row key和列族查问数据 // 表名 Row key 列族 > get 'Rumenz','001','user'9.查问表中所有的记录 // 表名> scan 'Rumenz'10.只查看某一列的数据 > scan 'Rumenz',{COLUMN=>'user:name'}11.只查看某一列族的数据 > scan 'Rumenz',{COLUMN=>'user'}12.分页查问 // STARTROW开始行,LIMIT=>1 取一条数据,VERSIONS=1 查问最新版本> scan 'Rumenz',{STARTROW=>'001',LIMIT=>1,VERSIONS=1}13.删除某一列中的某一列值 //user:name 为字段名 > delete 'Rumenz','001','user:name'14.删除某一行的值(通过Row key) ...

September 10, 2020 · 1 min · jiezi

关于大数据:HadoopHbase伪集群安装步骤

Hbase和Hadoop和jdk版本肯定要对应,不然很容易出错 Hbase和jdk版本对应关系 Java VersionHBase 1.3+HBase 2.1+HBase 2.3+JDK7反对不反对不反对JDK8反对反对反对JDK11不反对不反对没有测试Hbase和Hadoop版本对应关系 HBase-1.3.xHBase-1.4.xHBase-1.5.xHBase-2.1.xHBase-2.2.xHBase-2.3.xHadoop-2.4.x反对不反对不反对不反对不反对不反对Hadoop-2.5.x反对不反对不反对不反对不反对不反对Hadoop-2.6.0不反对不反对不反对不反对不反对不反对Hadoop-2.6.1+反对不反对不反对不反对不反对不反对Hadoop-2.7.0不反对不反对不反对不反对不反对不反对Hadoop-2.7.1+反对反对不反对反对不反对不反对Hadoop-2.8.[0-2]不反对不反对不反对不反对不反对不反对Hadoop-2.8.[3-4]没有测试没有测试不反对反对不反对不反对Hadoop-2.8.5+没有测试没有测试反对反对反对不反对Hadoop-2.9.[0-1]不反对不反对不反对不反对不反对不反对Hadoop-2.9.2+没有测试没有测试反对没有测试反对不反对Hadoop-2.10.0没有测试没有测试反对没有测试没有测试反对Hadoop-3.0.[0-2]不反对不反对不反对不反对不反对不反对Hadoop-3.0.3+不反对不反对不反对反对不反对不反对Hadoop-3.1.0不反对不反对不反对不反对不反对不反对Hadoop-3.1.1+不反对不反对不反对反对反对反对Hadoop-3.2.x不反对不反对不反对不反对反对反对Hase下载地址: https://hbase.apache.org/down...Hadoop下载地址: https://hadoop.apache.org/rel...jdk版本1.8 hadoop-3.2.1.tar.gz hbase-2.3.1-bin.tar.gz 1.装置hadoop > tar -xzvf hadoop-3.2.1.tar.gz//批改配置文件> cd hadoop-3.2.1/etc/hadoop//创立 /usr/local/hadoop 目录> mkdir /usr/local/hadoop> vim hadoop-env.sh//增加JAVA_HOMEexport JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el7_8.x86_64> vim hdsf-site.xml<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>file:/usr/local/hadoop/tmp/dfs/name</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>file:/usr/local/hadoop/tmp/dfs/data</value> </property></configuration>> vim core-site.xml<configuration> <property> <name>hadoop.tmp.dir</name> <value>file:/usr/local/hadoop/tmp</value> <description>Abase for other temporary directories.</description> </property> <property> <name>fs.defaultFS</name> <value>hdfs://localhost:9000</value> </property></configuration>执行 NameNode 的格式化> /root/hadoop/hadoop-3.2.1/bin/hdfs namenode -format启动hdfs> /root/hadoop/hadoop-3.2.1/sbin/start-dfs.sh谬误一:WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.hadoop1: ssh: Could not resolve hostname > hostnamehadoop1vim /etc/hosts127.0.0.1 hadoop1 //增加谬误二:localhost: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).> ssh localhost//首次登陆须要输出yes//输出明码1.设置无明码登陆//退出方才的登陆,留神此时还在服务器上,并没有退回到本地> exit> cd ~/.ssh> ssh-keygen -t rsa> cat ./id_rsa.pub >> ./authorized_keys> chmod 700 ~/.ssh> chmod 644 ~/.ssh/authorized_keys// .ssh须要是700权限// authorized_keys须要是644权限谬误三:ERROR: Attempting to operate on hdfs namenode as root> vim /root/hadoop/hadoop-3.2.1/etc/hadoop/hadoop-env.sh//头部增加export HDFS_DATANODE_USER=rootexport HADOOP_SECURE_DN_USER=hdfsexport HDFS_NAMENODE_USER=rootexport HDFS_SECONDARYNAMENODE_USER=rootexport YARN_RESOURCEMANAGER_USER=root而后重新启动进入Hadoop创立一个文件> /root/hadoop/hadoop-3.2.1/bin/hdfs dfs -mkdir /test//查看> /root/hadoop/hadoop-3.2.1/bin/hdfs dfs -ls /装置Hbase> tar -xzvf hbase-2.3.1-bin.tar.gz> cd hbase-2.3.1/conf//拷贝Hadoop中hdfs-site.xml和core-site.xml到当前目录> cp ../../hadoop-3.2.1/etc/hadoop/hdfs-site.xml .> cp ../../hadoop-3.2.1/etc/hadoop/core-site.xml .> vim hbase-env.sh//增加jdk环境变量export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el7_8.x86_64> vim hbase-size.xml<configuration> <property> <name>hbase.rootdir</name> <value>hdfs://127.0.0.1:9000/hbase</value> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/usr/local/hadoop/zookeeper</value> </property> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property></configuration>> mkdir /usr/local/hadoop/zookeeper拜访Hbase>/root/hadoop/hbase-2.3.1/bin/hbase shell网页拜访地址Hbase: http://xxx:16010/master-status//开启Hadoop网页拜访> /root/hadoop/hadoop-3.2.1/sbin/start-yarn.shHadoop: http://xxx:8088/clusterHadoop端口大全件节点默认端口配置用处阐明HDFSDataNode50010dfs.datanode.addressdatanode服务端口，用于数据传输HDFSDataNode50075dfs.datanode.http.addresshttp服务的端口HDFSDataNode50475dfs.datanode.https.addresshttps服务的端口HDFSDataNode50020dfs.datanode.ipc.addressipc服务的端口HDFSNameNode50070dfs.namenode.http-addresshttp服务的端口HDFSNameNode50470dfs.namenode.https-addresshttps服务的端口HDFSNameNode8020fs.defaultFS接管Client连贯的RPC端口，用于获取文件系统metadata信息。HDFSjournalnode8485dfs.journalnode.rpc-addressRPC服务HDFSjournalnode8480dfs.journalnode.http-addressHTTP服务HDFSZKFC8019dfs.ha.zkfc.portZooKeeper FailoverController，用于NN HAYARNResourceManager8032yarn.resourcemanager.addressRM的applications manager(ASM)端口YARNResourceManager8030yarn.resourcemanager.scheduler.addressscheduler组件的IPC端口YARNResourceManager8031yarn.resourcemanager.resource-tracker.addressIPCYARNResourceManager8033yarn.resourcemanager.admin.addressIPCYARNResourceManager8088yarn.resourcemanager.webapp.addresshttp服务端口YARNNodeManager8040yarn.nodemanager.localizer.addresslocalizer IPCYARNNodeManager8042yarn.nodemanager.webapp.addresshttp服务端口YARNNodeManager8041yarn.nodemanager.addressNM中container manager的端口YARNJobHistory Server10020mapreduce.jobhistory.addressIPCYARNJobHistory Server19888mapreduce.jobhistory.webapp.addresshttp服务端口HBaseMaster60000hbase.master.portIPCHBaseMaster60010hbase.master.info.porthttp服务端口HBaseRegionServer60020hbase.regionserver.portIPCHBaseRegionServer60030hbase.regionserver.info.porthttp服务端口HBaseHQuorumPeer2181hbase.zookeeper.property.clientPortHBase-managed ZK mode，应用独立的ZooKeeper集群则不会启用该端口。HBaseHQuorumPeer2888hbase.zookeeper.peerportHBase-managed ZK mode，应用独立的ZooKeeper集群则不会启用该端口。HBaseHQuorumPeer3888hbase.zookeeper.leaderportHBase-managed ZK mode，应用独立的ZooKeeper集群则不会启用该端口。HiveMetastore9083/etc/default/hive-metastore中export PORT=<port>来更新默认端口 HiveHiveServer10000/etc/hive/conf/hive-env.sh中export HIVE_SERVER2_THRIFT_PORT=<port>来更新默认端口 ZooKeeperServer2181/etc/zookeeper/conf/zoo.cfg中clientPort=<port>对客户端提供服务的端口ZooKeeperServer2888/etc/zookeeper/conf/zoo.cfg中server.x=[hostname]:nnnnn[:nnnnn]，标蓝局部follower用来连贯到leader，只在leader上监听该端口。ZooKeeperServer3888/etc/zookeeper/conf/zoo.cfg中server.x=[hostname]:nnnnn[:nnnnn]，标蓝局部用于leader选举的。只在electionAlg是1,2或3(默认)时须要。//批改默认端口> vim /root/hadoop/hadoop-3.2.1/etc/hadoop/yarn-site.xml// name 能够参照下面的表<configuration> <property> <name>yarn.resourcemanager.webapp.address</name> <value>xxx:8088</value> </property></configuration>//而后启动或者重启yarn(资源管理零碎)> /root/hadoop/hadoop-3.2.1/sbin/start-yarn.sh ...

September 9, 2020 · 1 min · jiezi

关于大数据:Fluid-让大数据和-AI-拥抱云原生的一块重要拼图

简介： 如何驱动大数据、AI 利用在云原生场景下高效运行是一个既有理论意义又具利用价值的重要挑战性问题，为系统化解决相干问题，学术界和工业界密切合作，南京大学 PASALab 副研究员顾荣博士、阿里云容器服务高级技术专家车漾、Alluxio 我的项目开创成员范斌博士联结推动发动了 Fluid开源合作项目。 作者 | 顾荣、车漾、范斌 得益于容器化带来的高效部署、麻利迭代，以及云计算在资源老本和弹性扩大方面的人造劣势，以 Kubernetes 为代表的云原生编排框架吸引着越来越多的 AI 与大数据利用在其上部署和运行。然而，云原生计算基金会（CNCF）全景图中始终缺失一款原生组件，以帮忙这些数据密集型利用在云原生场景下高效、平安、便捷地拜访数据。 如何驱动大数据、AI 利用在云原生场景下高效运行是一个既有理论意义又具利用价值的重要挑战性问题： 一方面，解决该问题需思考简单场景下利用协同编排、调度优化、数据缓存等一系列实践与技术难题；另一方面，该问题的解决可能无力地推动广大云服务场景下的大数据、AI 落地利用。为系统化解决相干问题，学术界和工业界密切合作，南京大学 PASALab 副研究员顾荣博士、阿里云容器服务高级技术专家车漾、Alluxio 我的项目开创成员范斌博士联结推动发动了 Fluid开源合作项目。 Fluid 是什么？Fluid 是一款开源的云原生基础架构我的项目。在计算和存储拆散的大背景驱动下，Fluid 的指标是为 AI 与大数据云原生利用提供一层高效便捷的数据抽象，将数据从存储形象进去，以便达到： 通过数据亲和性调度和分布式缓存引擎减速，实现数据和计算之间的交融，从而减速计算对数据的拜访；将数据独立于存储进行治理，并且通过Kubernetes的命名空间进行资源隔离，实现数据的平安隔离；将来自不同存储的数据联结起来进行运算，从而有机会突破不同存储的差异性带来的数据孤岛效应。通过 Kubernetes 服务提供的数据层形象，能够让数据像流体一样在诸如 HDFS、OSS、Ceph 等存储源和 Kubernetes 下层云原生利用计算之间灵便高效地挪动、复制、驱赶、转换和治理。而具体数据操作对用户通明，用户不用再放心拜访远端数据的效率、治理数据源的便捷性，以及如何帮忙 Kuberntes 做出运维调度决策等问题。用户只需以最天然的 Kubernetes 原生数据卷形式间接拜访形象进去的数据，残余工作和底层细节全副交给 Fluid 解决。 Fluid 我的项目以后次要关注数据集编排和利用编排这两个重要场景。数据集编排能够将指定数据集的数据缓存到指定个性的 Kubernetes 节点；而利用编排将指定该利用调度到能够或曾经存储了指定数据集的节点上。这两者还能够组合造成协同编排场景，即协同思考数据集和利用需要进行节点资源调度。 为什么云原生须要 Fluid?云原生环境与更早呈现的大数据处理框架在设计理念和机制上存在人造一致。深受 Google 三篇论文 GFS、MapReduce、BigTable 影响的 Hadoop 大数据生态，从诞生之初即崇奉和实际“挪动计算而不是数据”的理念。因而以 Spark，Hive，MapReduce 为代表的数据密集型计算框架及其利用为缩小数据传输，其设计更多地思考数据本地化架构。但随着时代的变迁，为兼顾资源扩大的灵活性与应用老本，计算和存储拆散的架构在更新兴的云原生环境中大行其道。因而云原生环境里须要相似 Fluid 这样的一款组件来补充大数据框架拥抱云原生带来的数据本地性缺失。 此外，在云原生环境中，利用通常以无状态（Stateless）微服务化形式部署，并不以数据处理为核心；而数据密集型框架和利用通常以数据抽象为核心，发展相干计算作业和工作的调配执行。当数据密集型框架融入云原生环境后，也须要像 Fluid 这样以数据抽象为核心的调度和调配框架来协同工作。 针对 Kubernetes 不足对利用数据的智能感知和调度优化的问题，及以 Alluxio 为例的数据编排引擎存在难以间接管控云原生基础架构层的局限，Fluid 提出数据利用协同编排、智能感知、联结优化等一系列翻新办法，并且造成一套云原生场景下数据密集型利用的高效撑持平台。 ...

September 8, 2020 · 1 min · jiezi

关于大数据:数据系统架构1基础数据篇

1.根底数据篇序(图-本篇文章波及红框内容，整体架构详见第一篇数据之旅-开篇) 本篇文章次要介绍一下根底数据局部，数据起源次要分成2方面，第一局部介绍一下日志相干内容，第二局部介绍一下业务源表相干，以及在此基础上构建的采集零碎与形象零碎，之后再介绍一些常见的问题与对应的解决方案。 总则：根底数据是大数据的根底，规范化、正当、精确的根底数据能够使后续的各类数据利用开发事倍功半。（根底数据非常重要！根底数据非常重要！根底数据非常重要！） 巧妇难为无米之炊，根底数据就是大数据开发中的原材料，资料的好坏间接影响着后续性能的复杂度、稳定性、准确性。只管根底数据这么重要，然而大多数状况下公司对根底数据的器重水平都不够，导致根底数据非常凌乱，比方：日志格局就算在同一个格局标准下都可能形形色色、百花齐放，导致后续统计各种兼容，徒增复杂度影响后续数据的准确性；业务表数据重复抽取浪费资源与抽取表设计不合理等等。 根底数据就是大数据的伊始，一个规范化、正当、精确的根底数据，能够为后续各种零碎打好根底。咱们须要有急躁和仔细逐渐梳理整顿各类信息，使根底数据调节清晰，数据东倒西歪。 日志品种与设计日志是对未产生业务数据变动的行为进行的记录，是对业务库数据的一种行为上的补充，基本要素为 who when what，谁在什么工夫产生了什么，从而对用户的行为进行记录与收集。以下日志格局是目前所采纳的格局，当然能够有其余的更优模式，只有设计正当即可，如json等等。 1. 前端日志日志定义：前端日志是用户在应用App或者Web页面利用，在App或者页面上收集到的用户行为信息,比方用户A在什么工夫点击了某个按钮、用户B在什么工夫浏览了某个商品的详情页等等。日志协定 分隔符：能够采纳 八进制不可见字符 '001'字符集：UTF-8工夫格局: 13位UNIX工夫戳日志格局设计： token：用户标识 [必须]uid:用户注册之后的ID信息[必须]action：用户行为[必须]page：页面[必须]timestamp：行为产生工夫[必须]datapool：规范字段之外扩大补充字段[必须]version：app客户端版本[可选]log_version:日志版本[可选]channelid：渠道[可选]os：操作系统[可选]osv：操作系统版本[可选]其余扩大字段...日志上报： SDK：App中提供的日志上报工具，把收集到的日志上报到对应的前端日志采集集群，日志采集集群把日志落地，以供后续flume配置采集，上传至kafka与HDFS。WEB接口：次要是提供给非App日志上报其余须要上报日志的场景，接口服务能够部署到采集集群里。2. 后端日志日志定义：后端日志是后端服务所打印的用户行为日志、零碎性能日志、异样排查日志等组合而成，各类日志应该依照不同的日志类型打印到不同的目录，以供后续采集应用。采集分2种状况，一种是失常微服务日志采集，另一种是服务云日志采集，不同的状况须要不同的采集计划。用户行为日志协定： 分隔符：采纳空格分隔（如果日志参数中存在空格会造成解析异样）协定：应用k=v的形式打印各类后端日志参数信息字符集：UTF-8工夫格局：13位UNIX工夫戳用户日志格局设计（不同模块能够打印各种kv参数信息）： server：服务模块token：用户token标识uid：用户uidaction：行为如 paySuccess、visittimestamp：日志工夫戳其余相干信息：如orderId，infoId...零碎性能日志 、异样排查日志 ，能够在零碎接入层拦挡对立打印与采集，日志格局上能够依据业务RD须要酌情设计，这2份日志次要是给业务RD做服务性能与问题排查。 3. 日志打印与品质因为RD分工与关注点不同，大家对各类日志器重水平不一，导致数据日志品质有时存在品质隐患，如何解决日志品质问题大抵有如下计划： 数据RD负责设计打印：数据开发负责统计日志打印，造成数据开发整体的闭环，从而在基本上解决日志品质问题。对于不同的统计需要以及后续的扩展性上能够失去充沛的思考与模型设计。在技术实现上临时思考通过注解等模式拦挡后端属性，通过配置化解析来打印对应日志，可行性上有待商讨；另一种就是在业务开发的代码中嵌入对应的日志打印，这种和失常的日志打印没有区别，次要是负责的人不一样，分工不同。（数据闭环、工作量大）业务RD负责日志打印：约定大于配置，进步业务RD数据日志标准理解与器重水平。另外如果有条件还请把统计日志打印退出到测试流程！变成测试上线必要流程，这样能力在很大水平上保障日志的品质。（疾速、标准上稍微升高。目前采纳这种形式，不过没有强制测试流程，日志品质会造成后续统计问题）业务源表增量抽取应用拉链表等相干表设计一张业务表只抽取一次，避免资源节约应用从库，避免影响线上失常业务采集技术日志采集：采集一般服务器就是应用flume进行采集；对应云服务日志采集能够应用Log-Pilot进行采集。 业务源表同步：能够通过sqoop抽取、或者canal解析binlog来同步数据，也能够采纳其余开源同步框架。 零碎设计配置化治理自动化异样采集复原监控体系建设元信息记录残缺全面日志形象 日志采集零碎架构设计如上图，大抵分为5个局部 内部零碎对接：次要感知内部对根底数据有影响的局部，做到及时处理，能够提供零碎对接的接口。简略状况主动解决并发送变动信息到相干人员。运维管理系统，感知服务器集群信息变动；服务管理系统，感知各类部署服务变动状况；DBA工单零碎，感知数据表构造变动新增批改等。日志管理系统配置管理：能够同步其余的零碎的元信息，配置管理日志采集信息，治理日志采集的源头与采集落地指标信息，如从某个服务集群的某个目录采集到某个HDFS地址、某个kakfa的topic下等等；源表数抽取：对应源表数据抽取配置，每天更加配置抽取对应的数据至HDFS，并映射成对应的hive表；智能自动化解决：对于简略的变动场景，尽量实现自动化解决；MySQL：各种配置信息存储。日志采集服务LogMaster：日志采集服务主节点，管理控制日志采集服务server，同时为了保障高可用采纳主从模式standby LogMaster-Secondary，在主节点不可用时通过zookeeper实现主从切换；Log-server：日志采集根底服务，在服务器部署时就须要当成根底服务来部署，服务启动之后与zookeeper放弃心跳；该server依据logMaster调配的工作治理采集本人服务器上对应的日志信息，并监控flume与log-pilot采集状况，出现异常上报logMaster；LogMaster-Secondary：从节点，在主节点不可用的状况下提供治理监控server执行状况与分配任务。元信息管理，把信息关联起来 【集群->服务->日志源->日志目的地（HDFS/Kafka）->日志形象内容->业务口径、指标形容】集群信息：同步与收集集群根本信息以及变动信息；服务信息：同步与收集各类服务变动信息；采集配置信息：系统配置的采集信息进行整顿收集；日志源表形象信息：日志与源表采集的日志须要进行形象，不光实现日志采集，还须要明确采集日志的内容信息，以供后续对立指标口径、业务逻辑配置化。采集监控，对系统设计的各个局部进行全方位监控采集服务监控集群服务变动监控日志数据落地监控，包含与数据源头数据量比照、日志自身同期比照监控等等数据表变动监控，监控数据表变动，尽量实现自动化解决抽取，无奈兼容的状况下须要人工染指日志与源表形象 日志与源表形象，就是为了把一份份日志映射成一个个的日志对象，为了后续描述统计逻辑、指标口径、业务逻辑打下数据根底。 结构化日志 前端日志：通过SDK或者WEB接口收集到的日志，在设计之初就是一个结构化的格局，所以能够间接映射成前端日志对象，而后通过配置对象中的action和page，标记日志类型，如曝光日志、点击日志、下单日志等；源表 ：源表个别都是mysql的数据，曾经是一种结构化的数据，同前端日志间接映射成源表对象与源表对象分类。非结构化日志 后端日志：因为后端日志各个服务打印各类参数泛滥，所以打印的时候采纳了可扩大的模式，为了映射成后端日志对象须要通过ELT把后端日志结构化，而后通过结构化的日志标记action，来辨别和标记各类后端日志。常见问题与解决方案没有明确日志标准，业务RD打印日志天马行空，后续各种兼容解1：约定大于配置解2：配置化治理解3：统计日志数据rd打印深刻业务2.日志抽象化没有遍及 解1：在日志申请采集时，须要记录 采集： 日志服务、服务器信息、目录信息、业务线、负责人、kafkatopic、日志形象信息配置；除了采集部署，须要通知零碎所采集的内容格局等3、业务源表反复抽取至hive，浪费资源 解1：业务表抽取，检测只容许抽取一次；能不全量抽取就不全量抽取，采纳增量拉链表等形式解2：应用canal抽取数据处理4、源表构造变动 解1：提供接口，接入到DBA数据库线上治理平台，有变动时 主动解决变动5、日志采集异样修复 解1：采集异样预案与工具化建设

September 4, 2020 · 1 min · jiezi

关于大数据:释放数据价值DAYU数据运营新能力解读

摘要：从比特到信息，这说的其实就是企业数字化转型，让数据的价值充分发挥进去，变成信息。明天，企业对数据越来越器重，数据曾经成为了企业新型的资产，甚至是外围资产，最近流传一句十分有意思的话：从比特到信息，这说的其实就是企业数字化转型，让数据的价值充分发挥进去，变成信息。 企业数字化转型外围就是在对本身数据深度认知的根底之上，管好数，用好数。然而这其实是一个十分不容易的过程，它面临着三道急需逾越的鸿沟： 第一道鸿沟是数据孤岛，传统的IT信息架构建设是利用驱动着往前走，存在“数据碎片化”，各企业和部门信息化水平不一样，零碎建设也自成体系、数据交融艰难；举个例子，一个中型的医院有超过50个利用零碎，一个省下辖的各级部门超过70个，面临着数百种不同的数据类型。 第二道鸿沟是对数据不足有序的治理：从2019年的几份征询报告来看，企业数据的利用率不到20%，超过80%的数据在沉睡，大部分企业对本身数据宝藏的意识还远远不够。 第三道鸿沟是不足零碎的平安治理，导致大家想用数，但又不敢释怀的用数：企业数据责权不一样，管数，用数的部门也往往不同，而企业的决策确又越来越多依赖全局的信息汇聚，如何平安的治理数据，应用数据是要解决的外围问题。 交融、凋谢的云化数据经营平台，开释数据之美面向企业数字化转型，华为云打造了交融、凋谢的云化数据经营平台DAYU，协同搭档，使能“从比特到信息”的价值发现，开释数据之美。 华为云大数据产品总监杨兴华 DAYU取名来自现代英雄大禹的名字谐音，寓意着治理、治理“数据”这一汪价值之水，在去年公布的1.0版本根底之上，进行了架构优化以及新个性的加强，上面来看一下DAYU的几个外围特点： 1.全域联邦数据资产治理：反对超过30+的数据源对接，通过河图引擎的虚构入湖技术，实现跨源跨域的数据发现与连贯，这无效的突破了数据孤岛，造成数据交融协同，同时也不毁坏原有的IT零碎建设，达到“立而不破”的成果。 2.凋谢的架构体系：围绕数据应用，构建端到端的欠缺的工具平台，秉承着“黑土地”的思维，往年又重构了整体架构，重心面向搭档协同，打造凋谢体系，提供分层API接口供搭档调用，包含根底的集成开发，元数据管理、平安治理，数据凋谢，以及高级的品质治理，数据模型，资产经营等，搭档能够依据本身零碎和业务特点按需集成。 3.共享型行业资产模型：在资产经营治理框架根底上，采纳模型驱动的理念实现资产的一键注入、导出、自动化治理，数据资产化效率实现3倍晋升，撑持搭档疾速构筑行业数据资产生态 上面来具体看一下往年重点强化和新增的两大个性：对立元数据管理和平安治理。 全域数据对立视图，让用户对数据资产深度“认知”元数据管理是整个数据经营平台的根底，也是外围，它很大水平上决定了对数据认知的深度。DAYU围绕数据目录、资产地图和数据血统，打造了进阶式的数据资产管理体系。 对立数据目录反对元数据的主动采集和更新，在数据类型上反对像表构造，文本等结构化数据，也反对图像，语音，视频等非构造数据，对全域数据构建对立的逻辑视图，帮忙企业造成数据的“一张网”。 资产地图的治理，借助了华为本身十几年数据管理体系建设的方法论，反对匹配企业信息架构的技术资产、业务资产、指标资产治理，具备资产分类和资产标签能力，实现自定义按需“管数”；同时反对资产概览，自定义资产报告能力，也内置华为自研的高性能搜索引擎，实现秒级“看数”。 而数据血统治理则对数据的关联关系有了进一步解读和认知，借助华为当先的大规模图计算技术，采纳图模型治理，对数据上下游的变动过程实现了残缺的刻画，全方位的展现了数据的前世今生。 全流程对立数据安全治理，让用户释怀“用数”上面再来看下数据安全治理，DAYU从最开始就围绕数据布局了欠缺的平安治理能力，次要蕴含五大版块：权限管控，合规审计，敏感发现，隐衷爱护，风险管理。 权限管控，同时反对基于角色和基于属性的两种访问控制模型，对各类数据资源和标签实现自定义受权，目前对数据的细粒度管控实际上以及做到了：库，表，列，视图级别。 合规审计：与数据权限治理实现联动，对全流程的数据操作日志进行审计，反对自定义的合规检查报告。 在敏感数据发现模块：反对对数据的分级分类，同时还联合了AI的办法，实现主动发现能力，将来在内置规定方面，将会联合各类数据安全规范的要求，继续丰盛。 隐衷爱护也是平安治理的一个外围，联合华为云齐备的根底平安能力，面向数据应用过程，DAYU致力于打造全流程的数据安全隐衷爱护，目前曾经实现了数据加密，数据脱敏，数据水印等技术，其余个性也将在将来的几个月陆续推出 在用数的过程中，风险管理也同样重要，目前曾经做到了对危险的实时预警治理。 携手搭档与DAYU协同，使能行业数据价值开释DAYU推出一年多以来，其端到端全流程数据可视治理，一键式资产积淀能力，减速了企业数字化转型的过程，受到行业搭档和客户的欢送，目前曾经在能源，政务，教育，园区，机场，工业制作等行业广泛应用。 华为云大数据将围绕数据价值使能，保持架构凋谢，继续丰盛各层级的API，进一步普惠搭档，助力搭档疾速积淀行业数据资产。 点击关注，第一工夫理解华为云陈腐技术~

September 2, 2020 · 1 min · jiezi

关于大数据:智慧公安系统开发-二维码报警系统解决方案

智慧公安系统开发 二维码报警零碎解决方案智慧类零碎研发服务商，多年智慧类技术钻研和多项胜利案例，业余的技术团队和服务团队，有现成的零碎，也可反对定制化开发。智慧公安系统开发，二维码报警零碎解决方案搭建可分割蔡先生13828808271微yzrhuhang互联网时代降临，每个畛域都投身智慧类建设当中，在公共安全方面也不例外。智慧公安系统就是联合了人工智能，大数据，物联网等多种高新技术的智慧类零碎建设之一，它使用于公共安全方面的多个畛域，像是刑侦，车流，行人治理等。明天所要讲述的是智慧公安系统外面的一个功能模块，叫做二维码报警零碎。二维码报警零碎建设的一个最次要的目标是，让警务人员能明确的晓得事变产生的地点或是报警人员的所在地。例如，在高速公路上产生了事变，或者有人员须要求救，但人们不晓得本人当初身处何地，怎么形容是哪一段路。这时，二维码报警零碎的作用就体现进去了。用户能够通过扫描二维码进行报警，这样，警务人员就能够通过用户扫码定位的地点，精确的晓得报警人员的所在地，间接达到事故现场，解决了许多冗余的步骤和不清晰的步骤，大大提高了警务人员的一个办事效率。上述的状况时人们无奈正确形容精确定位的时候所用到的。还有一种状况，就是人们不不便进行沟通谈话的时候，例如，人们看到有犯罪团伙作案，这时候想要报警为警方提供地位信息，用户就能够通过二维码报警零碎，不出任何声音，将地位信息提供给警方，让警方出警，打击犯罪分子。除了高速公路上的事变报警，犯罪分子作案时的无声报警，二维码报警零碎还能够使用到多个方面，像是火灾报警，急救报警等。当咱们来到一个生疏环境，像是目前人们所喜爱的户外探险，就会遇到各种各样的危险，人们就能够通过二维码报警来让警方实时精准疾速救济。二维码报警零碎是智慧公安系统内的一个版块，智慧公安是一个涉及面十分广的智慧类零碎，依据警方不同畛域的须要，能够进行定制化性能的开发，利用智慧公安系统，能够让警务人员办公的效率有一个质的飞跃。

September 1, 2020 · 1 min · jiezi

关于大数据:大数据计算的基石MapReduce

MapReduceGoogle File System提供了大数据存储的计划，这也为起初HDFS提供了理论依据，然而在大数据存储之上的大数据计算则不得不提到MapReduce。 尽管当初通过框架的一直倒退，MapReduce曾经慢慢的淡出人们的视线，越来越多的框架提供了简略的SQL语法来进行大数据计算。然而，MapReduce所提供的编程模型为这所有奠定了根底，所以Google的这篇MapReduce 论文值得咱们去认真的研读。 摘要MapReduce 是一个编程模型，也是一个解决和生成超大数据集的算法模型的相干实现。用户首先创立一个 Map 函数解决一个基于 key/value pair 的数据汇合，输入两头的基于 key/value pair 的数据汇合；而后再创立一个 Reduce 函数用来合并所有的具备雷同两头 key 值的两头 value 值。事实世界中有很多满足上述解决模型的例子，本论文将详细描述这个模型。MapReduce 架构的程序可能在大量的一般配置的计算机上实现并行化解决。这个零碎在运行时只关怀：如何宰割输出数据，在大量计算机组成的集群上的调度，集群中计算机的错误处理，治理集群中计算机之间必要的通信。采纳 MapReduce 架构能够使那些没有并行计算和分布式解决零碎开发教训的程序员无效利用分布式系统的丰盛资源。咱们的 MapReduce 实现运行在规模能够灵便调整的由一般机器组成的集群上：一个典型的 MapReduce计算往往由几千台机器组成、解决以 TB 计算的数据。程序员发现这个零碎十分好用：曾经实现了数以百计的 MapReduce 程序，在 Google 的集群上，每天都有 1000 多个 MapReduce 程序在执行。 1 介绍在过来的 5 年里，包含本文作者在内的 Google 的很多程序员，为了解决海量的原始数据，曾经实现了数以百计的、专用的计算方法。这些计算方法用来解决大量的原始数据，比方，文档抓取（相似网络爬虫的程序）、Web 申请日志等等；也为了计算解决各种类型的衍生数据，比方倒排索引、Web 文档的图构造的各种示意局势、每台主机上网络爬虫抓取的页面数量的汇总、每天被申请的最多的查问的汇合等等。大多数这样的数据处理运算在概念上很容易了解。然而因为输出的数据量微小，因而要想在可承受的工夫内实现运算，只有将这些计算散布在成千盈百的主机上。如何解决并行计算、如何散发数据、如何处理错误？所有这些问题综合在一起，须要大量的代码解决，因而也使得本来简略的运算变得难以解决。为了解决上述简单的问题，咱们设计一个新的形象模型，应用这个形象模型，咱们只有表述咱们想要执行的简略运算即可，而不用关怀并行计算、容错、数据分布、负载平衡等简单的细节，这些问题都被封装在了一个库外面。设计这个形象模型的灵感来自 Lisp 和许多其余函数式语言的 Map 和 Reduce 的原语。咱们意识到咱们大多数的运算都蕴含这样的操作：在输出数据的“逻辑”记录上利用 Map 操作得出一个两头 key/value pair 汇合，而后在所有具备雷同 key 值的 value 值上利用 Reduce 操作，从而达到合并两头的数据，失去一个想要的后果的目标。应用 MapReduce 模型，再联合用户实现的 Map 和 Reduce 函数，咱们就能够非常容易的实现大规模并行化计算；通过 MapReduce 模型自带的“再次执行”（re-execution）性能，也提供了高级的容灾实现计划。这个工作(实现一个 MapReduce 框架模型)的次要奉献是通过简略的接口来实现主动的并行化和大规模的分布式计算，通过应用 MapReduce 模型接口实现在大量一般的 PC 机上高性能计算。第二局部形容根本的编程模型和一些应用案例。第三局部形容了一个通过裁剪的、适宜咱们的基于集群的计算环境MapReduce 实现。第四局部形容咱们认为在 MapReduce 编程模型中一些实用的技巧。第五局部对于各种不同的工作，测量咱们 MapReduce 实现的性能。第六局部揭示了在 Google 外部如何应用 MapReduce 作为根底重写咱们的索引零碎产品，包含其它一些应用 MapReduce 的教训。第七局部探讨相干的和将来的工作。 ...

September 1, 2020 · 7 min · jiezi

关于大数据:rtmp规范10全面指南

RTMP（real time messaging protocol）协定 本文为Adobe rtmp标准1.0的中文介绍，其中内容大部分都是翻译自rtmp官网文档rtmp_specification_1.0.pdf 具体文章目录参见文章内侧边栏<!--more--> 介绍Adobe的实时音讯传输协定（RTMP）通过牢靠的流传输（如TCP [RFC0793]）提供双向音讯多路传输服务，用于在端到端之间传输带有时序信息的视频，音频和数据音讯的并行流。 穿过多层流，RTMP音讯块流不提供任何管制的优先级别和类似模式，然而能够用于高层协定提供这样的优先级，例如：一段实时视频服务会抉择抛弃给迟缓的客户的视频信息确保音频信息能够及时被接管。RTMP音讯块流蕴含它本人的入队协定管制音讯，也提供一个高层协定机制用于嵌入用户的管制音讯。 定义无效负载：Payload 蕴含在包中的数据，就像音频样本或者压缩的视频数据。 包：Packet 一个数据包由固定的包头和无效负载数据组成，一些底层协定或者须要包的封装来被定义。 端口：Port 在TCP/IP协定中定义的用正整数示意的端口号用于在传输中提取以辨别指标主机的不同利用，用于OSI传输层的传输抉择（TSEL）就是端口。 传输地址：Transport address 网络地址和端口的组合辨认一个传输层终端端口，例如一个IP地址和TCP端口，数据包从一个源传输层地址传送到指标段的传输层地址。 音讯流：Message stream 一个通信的逻辑通道，容许音讯流通。 音讯流ID：Message stream ID 每一个音讯领有一个调配的ID辨认追随的音讯流。 音讯块：Chunk 音讯的片段，音讯被分成小的局部，在他们在网络中发送之前穿插存储。音讯块确保定制工夫戳的端到端全音讯传送，穿过多层流。 音讯块流：Chunk stream 一个通信的逻辑通道，容许音讯块在一个特定的方向上流通，音讯块流能够从客户端传送到服务器，也能够相同。 音讯块流ID：Chunk stream ID 每一个音讯块有一个调配的ID用于辨认更随的音讯块流。 复合技术：Multiplexing 把离开的音视频数据组合成一条音视频流的过程，使同时传送许多音视频数据成为可能。 逆复合技术：DeMultiplexing 复合的反向过程，穿插存取组装的音频视频数据，使他们成为最后的音视频数据 近程过程调用：Remote Procedure Call (RPC) 容许客户端或服务器在对等端调用子例程或过程的申请。 Action Message Format (AMF) 一种紧凑的二进制格局，用于序列化ActionScript object graphs。 能够透过 AMF overHTTP的形式将flash端材料编码后传回server，server端的remoting adaptor接管到材料后则会译码回正确的native对象，交给正确的程序处理。 字节程序，对齐和工夫格局所有的整数字段都被引入到了字节程序当中，字节0是第一个显示进去的，也是一个词和一个字段中最重要的。这种程序就是通常所说的“大端”。如果没有非凡阐明，在本文档中数字常量都是用十进制示意。 除另有规定外，RTMP中的所有数据都是字节对齐的。例如，一个16位字段可能处于奇数字节偏移处。 在指定填充的中央，填充字节应该是0。 RTMP中的工夫戳绝对于未指定的期间是以整数毫秒为单位给出的。 通常，每个流将以工夫戳0开始，但这不是必须的，只有两个终端在工夫点上达成统一。 请留神，这意味着跨多个流（尤其是来自不同主机）的任何同步都须要一些RTMP外的其余机制。 工夫戳必须始终在线性的减少，容许利用程序处理异步传输，带宽度量，检测，和流控制。 因为工夫戳长度为32位，因而它们每隔49天，17小时，2分钟，47.296秒滚动一次。 因为流能够间断运行，可能继续数年，RTMP应用程序应该在解决工夫戳时应用序列号算法[RFC1982]，并且应该可能解决回绕。 例如，假设所有相邻的工夫戳都在2^31 - 1毫秒之间，所以10000会在4000000000之后，而3000000000会在4000000000之前。 ...

August 31, 2020 · 3 min · jiezi

关于大数据:鹰眼海量级分布式日志系统上云的架构和实践

导语 | 鹰眼是由腾讯PCG技术运营部负责的海量级分布式实时监控和日志剖析零碎，为响应公司策略要求，将原先的业务迁徙上云，最终产生了可喜的变动。本文将介绍分布式日志零碎（鹰眼）的整体上云计划，心愿与大家一起交换。一、鹰眼平台介绍鹰眼是由PCG技术运营部负责的海量级分布式实时监控和日志剖析零碎，反对多语言的上报，域名为：_http://log2.oa.com/_ 鹰眼的数据上报是通过ATTA提供的，ATTA反对多语言的上报（JAVA，Python，C++等），上报之后，鹰眼从ATTA零碎拉取数据最终写入到ES，通过ES的倒排索引机制，疾速查问性能，写入性能等。 应用ES的倒排索引机制，百亿数据秒级查问返回的能力，鹰眼提供了以下性能： 1. 实时日志查问服务数据实时日志查问服务数据上报到ATTA之后，开发能够通过鹰眼及时查问到日志，定位问题，运维能够通过鹰眼提供的数据统计界面实时查问到业务的运行状况。 2. 数据分析能力鹰眼数据入库后，用户能够通过API间接调用，进行OLAP剖析。 3. 谬误日志告警服务程序如果呈现谬误之后，能够依照鹰眼标准来上报谬误日志，鹰眼进行分词，依据不同的错误码进行分钟级别的告警。 4. grafana实时剖析告警通过grafana对上报到鹰眼的数据进行实时的剖析告警。（因为ES不反对大并发查问，所以无奈对超大数据进行实时剖析） 二、上云的背景公司策略调整，成立新的云事业群，外部成立“技术委员会”，启动“开源协同”和“业务上云”的两大策略方向。 在架构演进中，鹰眼团队上云能失去什么益处？上云的价值是什么？ 1. 业务价值聚焦业务，晋升研发效率 ；放慢技术换代，放弃技术劣势（传统互联网 vs 云时代）；应用更好的云开源组件服务（可用性、稳定性、文档API…）；计算资源重用，弹性伸缩，优化老本 ；标准化CI/CD流程。2. 工程师价值扩宽技术视线，防止闭门造车 ；把握的技能更有价值 ；输入优良组件到云，进步影响力。3. 腾讯云价值为客户输入业务上云教训 ；帮忙腾讯云打磨云组件。三、组件上云架构选型为了保障业务的延续性和架构的演进，数据导入过程中的主体流程并没有太大扭转，Kafka间接应用到云上的CKAFKA，ES间接应用到云上的ES。 ES和Kafka间接应用云上组件，其余组件须要进行重构。 1. 重构LogSender生产者程序写入Kafka性能瓶颈特地大，高峰期丢数据特地重大。 生产者程序写数据流程：读取BOSS订阅->IP解析->写入Kafka。 （1）IP解析性能瓶颈之前生产者程序是C++版本，通过打印日志，发现高峰期IP解析耗时特地重大。排查代码，发现IP解析加锁了。所以高峰期丢数据特地重大。解决办法是：将IP解析改为二分查找算法来进行IP定位，而后勾销锁，解决。 （2）Kafka性能瓶颈问题因为咱们生产者程序，一个程序会读取很多很多个topic，而后写入到Kafka，咱们尝试，应用一个producer和多个producer发送，性能都晋升不起来。 通过源代码排查，发现Kafka发送时，会依据topic分区来锁队列，当这个队列满的时候，就会发送一批音讯进来。所以解决方案为，每个BOSSID应该有独立的发送客户端。 数据量大的，有多个Kafka客户端数据量小的一批topic，能够共用一个kafka生产者。 优化之后：在数据量十分大的时候，因为程序性能起因，会导致一分钟单节点最多只能解决13万条左右的数据。改良后， 单节点能解决55w条左右的数据。  性能晋升4倍。 2. Kafka选型Kafka整体来说，高版本比低版本反对的性能更多，如事务，磁盘间的数据转移等，写入性能并不会降落。此处选型选的是最高版本。 当然CKAFKA并没有给咱们抉择版本的机会，客户端写入的时候还是得留神下和Kafka服务端版本统一，防止不必要的问题。 如低版本的客户端写入高版本的Kafka时，如果应用数据压缩，则服务端承受到数据后，会进行解压，而后再依照对应的格局压缩（如果版本统一，则不会有此动作），减少服务端的运行老本。 Kafka上云之后，单机性能能达到400MB/s，而咱们自建的Kafka，单机性能最多达到100MB/s，性能晋升4倍。 3. 重构HangoutES写入局部，业界有很多组件，最闻名的是Logstach，因为性能不够，咱们本人从新开发了一套读取Kafka写入ES的组件。 外围优化点如下所示： 因为磁盘IO的大幅缩小，能在极限优化下持续晋升性能2倍以上。整体来说，ES写入晋升性能6倍左右。 4. ES选型ES低版本反对TCP写入和HTTP写入两种形式，高版本只反对一种HTTP写入形式。实测发现有如下区别： TCP写入比HTTP更快；HTTP写入更稳固一点，TCP写入是间接写到节点下面的，容易呈现负载不平衡，HTTP更容易通过数据节点节点进行负载平衡。因而咱们采纳了云版本ES 6.8.2。 上云之后的成果： 均匀写入1TB数据，云下须要 80核，256G内存 12TB磁盘 （BX1机型）；云上须要  3 * （16核 64GB 5TB硬盘 ）；均匀节俭资源1倍左右。四、上云之后的变动ES/Kafka上云之后，统计有50多个ES集群，12个Kafka集群. ...

August 31, 2020 · 1 min · jiezi

关于大数据:Scala核心编程Scala概述

why is Scala 语言？Spark 新一代内存级大数据计算框架，是大数据的重要内容Spark就是应用Scala编写的。因而为了更好的学习Spark，须要把握Scala这门语言Scala是Scalable Language的简写，是一门多范式（面向对象，函数式）的编程语言Spark的衰亡，带动Scala的倒退！Scala语言诞生小故事 创始人马丁·奥德斯基（Martin Ordersky）是编译器及编程的狂热爱好者，在长时间编程后，心愿创造一种语言，可能让写程序这样的根底工作变得高效，简略。所以当接触到Java语言后，对Java这门便携式，运行在网络，且存在回收机制的语言产生了极大的趣味，所以决定将函数式编程语言的特点交融到Java中，由此创造了两种语言（Pizza & Scala） Scala的类库Scala特有的类库对Java的类进行的包装Scala语言特点Scala是一门以Java虚拟机为运行环境并将面向对象和函数式编程的最佳个性联合在一起的动态类型编程语言Scala源代码（.scala）会被编译成Java字节码（.class），而后运行于JVM之上，并能够调用现有的Java类库，实现两种语言的无缝对接Scala单作为一门语言来看，十分简洁高效

August 30, 2020 · 1 min · jiezi

关于大数据:腾讯云大数据神盾首创非对称联邦学习深度保障数据隐私

导语：在过来的几年中，咱们见证了大数据及人工智能技术的飞速发展，许多机构却仍旧苦于数据数量少、品质低等难题而无奈将前沿实践商业化落地。助力像石油般贵重的数据冲破隐衷爱护的条框限度并实现其价值的流通，对相干产业的倒退起着至关重要的作用。在上一篇文章中，咱们简要介绍了腾讯“神盾-联邦计算”平台的诞生背景和数据安全与隐衷爱护技术亮点。这次，咱们着重选取本产品首推的“非对称联邦学习” (Asymmetrical Federated Learning, AFL) 范式进行介绍。该范式旨在全面爱护数据集的样本ID、特色和标签的隐衷平安，彻底解除在不均衡的 (unbalanced) 联邦计算零碎中，中小企业对敏感用户ID泄露问题的担心。文章作者：刘洋，腾讯神盾-联邦计算平台项目组 一、钻研背景在风控、营销、举荐、AI等支流业务中，腾讯“神盾-联邦计算”平台以底层强有力的隐衷爱护技术为撑持，以上层先进高效的信息分享、数据挖掘、人工智能算法为进口，向包含企业、学校、医院和政府等在内的各类独立机构提供联邦计算零碎的无门槛搭建、计算、建模和推理等服务。腾讯“神盾-联邦计算”平台旨在撮合有数据需要的业务方和有价值变现需要的数据方之间开展单干。在单干过程中，神盾秉承始终保持各机构原始数据平安的准则，令各机构偏心地享受联邦计算成绩。 为了达成以上指标，腾讯“神盾-联邦计算”平台在数年来的孵化和成长中，逐步吸纳了数据安全与隐衷爱护畛域的两大核心技术： 以不经意传输 (Oblivious Transfer, OT)、机密分享 (Secret Sharing, SS) 和同态加密 (Homomorphic Encryption, HE) 为代表的平安多方计算 (Secure Multiparty Computation, MPC) 技术。该类技术通常以在分布式隐衷数据之上的个别函数求值为指标，在半个多个世纪倒退中慢慢造成了严格的精度、效率和安全性度量。以联邦学习 (Federated Learning, FL) 为代表的面向隐衷爱护的分布式机器学习 (Privacy-Preserving Distributed Machine Learning, PPDML) 技术。该类技术通常以将现有的隐衷爱护技术奇妙地集成到经典的数据挖掘和统计学习算法中为指标。因为许多模型训练所基于的最优化及贪婪算法计算量宏大，所以该类技术对高计算效率和低通信复杂度有着狂热的谋求。 从上图能够看出，在腾讯“神盾-联邦计算”平台的底层技术栈中，PPDML与MPC并不仅仅是单纯的并列关系。正如以上第 (2) 条中提到，PPDML通常联合了MPC的诸多经典平安技术，对学业界常见的机器学习算法做隐衷爱护模式的革新。实际上，在许多理论业务场景中，尤其是现如今的金融风控和精准营销场景等中，相干大型企业曾经无比善于利用成型的机器学习零碎，对本人把握的用户的高维特色和历史行为标签做数据挖掘，最初基于开掘失去的机器学习模型对新用户做业务预测，达到升高信用风险、打压黑灰产、扩充市场份额和缩小获客老本等目标。因而，绝对于MPC自身，与现行机器学习零碎更贴近的PPDML技术领有更强的理论业务场景诉求，并且，这种诉求更多来自于不足大规模、高质量数据集的中小企业。 以腾讯“神盾-联邦计算”平台频繁应用的PPDML下的FL技术为例。在纵向FL的规范范式 [1] 中，参与方顺次执行以下步骤： 加密实体对齐 (encrypted entity alignment)：参与方采纳MPC技术获取所有参与方把握的样本ID交加，而不裸露ID非交加内容。这里通常采纳为MPC中的隐衷汇合求交 (Private Set Intersection, PSI) 技术。加密模型训练 (encrypted model training)：每一个参与方听从预设的联邦协定，基于本人把握的原始数据计算取得两头变量，将加密或混同后的两头变量与其余参与方交互，以期单干训练取得高质量的机器学习模型。在联邦协定的执行过程中，各参与方的隐衷数据集的特色和标签隐衷被重点关注和爱护。以两方FL为例，上述的FL规范范式能够被下图示意： 能够看出，两方的ID量级相当，被默认成一种强强联手状态的均衡的 (balanced) 多方常识散布。确实，FL规范范式通过第 (1) 步保障了样本ID非交加内容的隐衷平安，通过第 (2) 步保障了两数据集的特色与标签隐衷平安。然而，它却容许样本ID交加内容成为必向各方公开的信息。以下数值试验量化了FL规范范式的这种缺点造成的样本ID隐衷泄露水平。 假如样本ID选集为全国人手机号，共14亿个，而两参与方Alice和Bob各把握8亿个手机号，别离是bc + cd和bc + ab。进一步地，咱们假如单方有6亿手机号的交加bc。另有4亿手机号de不被单方所把握。这种ID散布能够由下图示意： ...

August 28, 2020 · 1 min · jiezi

关于大数据:技本功Hive优化之Spark执行引擎参数调优二

Hive是大数据畛域罕用的组件之一，次要是大数据离线数仓的运算，对于Hive的性能调优在日常工作和面试中是常常波及的的一个点，因而把握一些Hive调优是必不可少的一项技能。影响Hive效率的次要有数据歪斜、数据冗余、job的IO以及不同底层引擎配置状况和Hive自身参数和HiveSQL的执行等因素。本文次要结合实际业务状况，在应用Spark作为底层引擎时，通过一些常见的配置参数对报错工作进行调整优化。 上面从两个方面对简单工作的优化： Spark资源参数优化次要针对Spark运行过程中各个应用资源的中央，通过调节资源相干参数，来优化资源应用的效率，从而晋升Spark作业的执行性能。例如：num-executors、executor-memory、executor-cores等。 Shuffle相干参数调优次要针对spark运行过程中的shuffle，通过调节参数，进步shuffle的执行效率，从而晋升spark作业的执行性能。例如：spark.shuffle.memoryFraction,spark.sql.shuffle.partitions等。 案例1简单工作执行失败，大概有400行sql，较为简单，join聚合函数操作较多。手动重试工作后依然报错。查看工作报错日志 剖析要害信息 Exception in thread "broadcast-exchange-0" java.lang.OutOfMemoryError: Not enough memory to build and broadcast the table to all worker nodes. As a workaround, you can either disable broadcast by setting spark.sql.autoBroadcastJoinThreshold to -1 or increase the spark driver memory by setting spark.driver.memory to a higher value得出结论以后所有的工作节点均没有足够的内存去build并且播送表，倡议解决办法：将播送置为有效或者减少spark的driver memory。 优化成果通过比照测试验证，在同时调大excutor内存和driver内存后，工作能够胜利运行。独自调大driver或excutor内存，工作运行仍然失败。 Q1：什么状况下应将播送设置为有效？依据官网文档对该参数的形容可知：其默认值为10M，意味着执行join时，这张表字节大小在10M内能够主动播送到所有工作节点。将表播送到其余工作节点，会缩小shuffle的过程，晋升效率。如果在内存足够并且数据量过多的状况下，能够将适当进步该参数值作为一种优化伎俩。如果在表都很大的状况下，倡议将主动播送参数置为有效。将参数值设置为-1时会禁用主动播送。 案例2 某个工作曾经运行了40多个小时，主动重试了3次，始终处于阻塞状态。查看异样工作SQL 发现工作中由10多个SQL语句形成，一个语句大略有200+行，union all、join、sum操作较多。 查看工作报错日志 剖析要害信息 org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 433得出结论个别工作有大量shuffle操作的时候，咱们能够从shuffle数据量及shuffle分区数的角度对工作进行优化调整。 优化成果 只采取调大executor内存的形式进行优化，工作能够运行胜利，但工作执行耗时依然需20+分钟，执行效率与优化前相比无显著变动。起因在于工作执行中产生了较多的task，此时能够通过调整分区参数进行深刻优化。分区参数spark.sql.shuffle.partitions是Spark SQL专用的设置，将该参数的值由200（默认值）调小为50，工作运行胜利，执行耗时缩小50%，约10分钟；持续将该参数调小为10，工作运行胜利，执行耗时缩小70%，约6分钟，优化实现。 **Q2：spark.default.parallelism参数与spark.sql.shuffle.partitions参数有什么区别？** 尽管这两个参数较为类似，但default.parallelism只在解决RDD时才会起作用，对Spark SQL有效。其值设置为【num- executors * executor-cores】的2~3倍较为正当。能够参考官网的定义阐明： ...

August 28, 2020 · 1 min · jiezi

关于大数据:数据之旅开篇

开篇 2020年曾经过来大半，从13年毕业到当初，人不知;鬼不觉曾经工作了7年的工夫。在这些年的工夫里做过WEB开发、大数据相干等工作，去过传统IT企业也去过互联网公司。新的一年总要有些提高与扭转，那就开始写总结吧，做些有意义的事件。算是给本人职业生涯做一次回顾，分享一些技术与想法，如果有能帮忙到其他人，或者略微有些启发，也算是有点价值。如果有任何谬误或者疑难的中央也欢送大家留言斧正与探讨。 总结分享布局： 首先大数据相干的技术，我分成大抵分成两个方面，一个是技术架构，一个是零碎架构。 技术架构方面，大多数公司应用的技术基本上都大同小异，都是基于各种开源大数据相干组件，搭建各种集群来反对公司各类数据的统计分析； 零碎架构方面，因为每个公司本身倒退须要、数据器重水平、开发人员资源的不同，之间可能会有些许的差别，上图是我总结进去的零碎架构，之后会优先依照零碎架构设计方面动手，从数据的采集、数据的传输、数据的计算、数据的利用等等方面，开始逐渐总结一下各个系统的设计。 大抵布局如上，都是一些接触过的技术或者工作中遇到的问题的思考与总结，依据状况再逐渐调整吧，望本人可能保持的写下去，fighting！ 最初安利一个本人的小我的项目life schedule - Follow Your Dream http://www.jixianshijie.com/ (别的我的项目的域名，拿来用用…) 依据你的出生日期，抉择你要布局的年限，能够看到你曾经过了多少的工夫，处在人生的什么阶段，还剩多少的日子。双击一段时间范畴能够做做标记事件记录等等…. 逝者如斯不舍昼夜，再登程！

August 28, 2020 · 1 min · jiezi

关于大数据:三网运营商大数据实时截流网站访客

当初很多行业和企业都在网上,手机APP和搜索引擎做竞价引流推广，目标是为本人的企业和业务实时引流获客。然而随着泛滥资本的染指，和竞价排名的歹意竞争和歹意点击的呈现，很多企业做的竞价推广并不尽如人意。 因为无论是网站推广还是竞价排名，只有客户点击了网站，并且被动留下了个人信息，相干企业才能够获取他的个人信息，业务员才能够与之触达。 那些拜访了网站，但并没有留下联系方式的客户，对于做推广的企业来讲就算是散失的客户群体，其实散失的客户比重占所有来访的客户的80%-95%。 如何能留住如此宏大的访客群体，不让其散失呢？三网运营商大数据实时截流能够做到让网站访客不再散失！ 在相干领有服务器开发权限的网站内退出一道程序，通过运营商大数据的数据接口接入到该网站，运营商受权后，能够进行访客数据实时回调，相干企业即可通过实时回调访客信息数据到TXT文档等形式实时查看访客信息数据，个别数据输送提早为几毫秒。 通过以上形式即可留住网站所有访客信息，让访客不再散失。 [](https://www.sohu.com/?strateg... "点击进入搜狐首页")

August 28, 2020 · 1 min · jiezi

关于大数据:连载阿里巴巴大数据实践数据服务

简介： 服务架构的每次降级，均在性能、稳定性、扩展性等方面有所晋升，从而能更好地服务于用户 前言： -更多对于数智化转型、数据中台内容请退出阿里云数据中台交换群—数智俱乐部 和关注官网微信公总号（文末扫描二维码或点此退出） -阿里云数据中台官网 https://dp.alibaba.com/index起源：数智化转型俱乐部 数据部门产出的海量数据，如何能不便高效地凋谢进来，是咱们始终想要解决的难题。在没有数据服务的年代，数据凋谢的形式简略、粗犷，个别是间接将数据导出给对方。这种形式不仅低效，还带来了安全隐患等诸多问题。 为此，咱们在数据服务这个方向上一直摸索和实际。最早的数据服务雏形诞生于2010年，至今已有7个年头。在这期间，随着咱们对业务的了解一直加深，同时也得益于新技术的继续涌现，对数据服务架构也进行了屡次降级革新。服务架构的每次降级，均在性能、稳定性、扩展性等方面有所晋升，从而能更好地服务于用户。 1．服务架构的演进阿里数据服务架构演进过程如图6.1所示。基于性能、扩展性和稳定性等方面的要求，咱们一直降级数据服务的架构，顺次经验了外部代号为DWSOA、OpenAPI、SmartDQ和OneService的四个阶段。 阿里数据服务架构演进过程 其中，第四个阶段是对立的数据服务层（即OneService）。大家心里可能会有疑难：SQL并不能解决简单的业务逻辑啊。的确，SmartDQ其实只满足了简略的查问服务需要。咱们遇到的场景还有这么几类：个性化的垂直业务场景、实时数据推送服务、定时工作服务。所以OneService次要是提供多种服务类型来满足用户需要，别离是OneService-SmartDQ、OneService-Lego、OneService-iPush、OneService-uTiming。 在OneService阶段，开始真正走向平台化。咱们提供数据服务的外围引擎、开发配置平台以及门户网站。数据生产者将数据入库之后，服务提供者能够依据标准规范疾速创立服务、公布服务、监控服务、下线服务，服务调用者能够在门户网站中疾速检索服务，申请权限和调用服务。 2．技术架构SmartDQ SmartDQ的元数据模型架构示意图 SmartDQ的元数据模型，简略来说，就是逻辑表到物理表的映射。自底向上别离是： （1）数据源：SmartDQ反对跨数据源查问，底层反对接入多种数据源，比方MySQL、HBase、OpenSearch等。 （2）物理表：物理表是具体某个数据源中的一张表。每张物理表都须要指明主键由哪些列组成，主键确定后即可得悉该表的统计粒度。 （3）逻辑表：逻辑表能够了解为数据库中的视图，是一张虚构表，也能够看作是由若干主键雷同的物理表形成的大宽表。SmartDQ对用户展示的只是逻辑表，从而屏蔽了底层物理表的存储细节。 （4）主题：逻辑表个别会挂载在某个主题下，以便进行治理与查找。 iPush iPush利用架构示意图 iPush利用产品是一个面向TT、MetaQ等不同音讯源，通过定制过滤规定，向Web、无线等终端推送音讯的中间件平台。iPush外围服务器端基于高性能异步事件驱动模型的网络通信框架Netty 4实现，联合应用Guava缓存实现本地注册信息的存储，Filter与Server之间的通信采纳Thrift异步调用高效服务实现，音讯基于Disruptor高性能的异步解决框架（能够认为是最快的音讯框架）的音讯队列，在服务器运行中Zookeeper实时监控服务器状态，以及通过Diamond作为对立的管制触发核心。 LegoLego被设计成一个面向中度和高度定制化数据查问需要、反对插件机制的服务容器。它自身只提供日志、服务注册、Diamond配置监听、鉴权、数据源治理等一系列基础设施，具体的数据服务则由服务插件提供。基于Lego的插件框架能够疾速实现个性化需要并公布上线。 Lego采纳轻量级的Node.JS技术栈实现，适宜解决高并发、低提早的IO密集型场景，目前次要撑持用户辨认发码、用户辨认、用户画像、人群透视和人群圈选等在线服务。底层依据需要特点别离选用Tair、HBase、ADS存储数据。 uTiming uTiming是基于在云端的任务调度利用，提供批量数据处理服务。uTiming-scheduler负责调度执行SQL或特定配置的离线工作，但并不间接对用户裸露任务调度接口。用户应用数据超市工具或Lego API建设工作。注：本书中呈现的局部专有名词、专业术语、产品名称、软件项目名称、工具名称等，是淘宝（中国）软件有限公司外部我的项目的习用词语，如与第三方名称雷同，实属偶合。 节选自《大数据之路：阿里巴巴大数据实际》已受版权保护，未经受权不得转载 连载：阿里巴巴大数据实际—数据开发平台>> 连载：阿里巴巴大数据实际—实时技术>> 连载：阿里巴巴大数据实际—数据服务>> 数据中台是企业数智化的新基建，阿里巴巴认为数据中台是集方法论、工具、组织于一体的，“快”、“准”、“全”、“统”、“通”的智能大数据体系。目前正通过阿里云数据中台解决方案对外输入，包含批发、金融、互联网、政务等畛域，其中外围产品有： Dataphin，一站式、智能化的数据构建及治理平台；Quick BI，随时随地 智能决策；Quick Audience，全方位洞察、全域营销、智能增长；Quick A+， 跨多端全域利用体验剖析及洞察的一站式数据化经营平台；官方站点： 数据中台官网 https://dp.alibaba.com

August 27, 2020 · 1 min · jiezi