{"id":65787,"date":"2022-01-18T09:50:59","date_gmt":"2022-01-18T09:50:59","guid":{"rendered":"https:\/\/www.artefact.com\/?post_type=news&p=65787"},"modified":"2024-09-20T17:45:48","modified_gmt":"2024-09-20T16:45:48","slug":"how-to-quickly-compare-two-datasets-using-a-generic-and-powerful-sql-query","status":"publish","type":"blog","link":"https:\/\/www.artefact.com\/zh\/blog\/how-to-quickly-compare-two-datasets-using-a-generic-and-powerful-sql-query\/","title":{"rendered":"\u5982\u4f55\u4f7f\u7528\u529f\u80fd\u5f3a\u5927\u7684\u901a\u7528 SQL \u67e5\u8be2\u5feb\u901f\u6bd4\u8f83\u4e24\u4e2a data \u6570\u636e\u96c6"},"content":{"rendered":"

\u4f5c\u8005<\/h2><\/div>\"Image\"

\u51ef\u6587-\u52d2\u8d39\u5c14<\/h3><\/div>

Data \u5f00\u53d1\u4eba\u5458\u5728 Artefact<\/p>\n<\/div><\/div><\/div><\/div><\/div>

<\/span><\/a><\/span>

\u9605\u8bfb\u6211\u4eec\u7684\u6587\u7ae0<\/u><\/p>\n<\/div>

<\/span><\/div>

.<\/p>\n<\/div><\/div><\/div><\/div><\/div>

\u5728\u65e5\u5e38\u5de5\u4f5c\u4e2d\uff0cData Engineer \u548c Data \u5206\u6790\u5e08\u9700\u8981\u6539\u8fdb data \u91c7\u96c6\u6d41\u7a0b\u3002\u9664\u4e86\u5e38\u89c4\u7684\u5355\u5143\u6d4b\u8bd5\u5916\uff0c\u51fa\u4e8e\u5f71\u54cd\u5206\u6790\u6216\u975e\u56de\u5f52\u6d4b\u8bd5\u7b49\u4e0d\u540c\u76ee\u7684\uff0c\u7b80\u5355\u5feb\u901f\u5730\u6bd4\u8f83\u4e24\u4e2a data \u96c6\uff08\u5373\u8868\u3001\u89c6\u56fe\u3001\u67e5\u8be2\u7b49\uff09\u53ef\u80fd\u4e5f\u5f88\u6709\u8da3\u3002\u6b64\u5916\uff0c\u8bc6\u522b\u5feb\u7167\u8868\u7684\u4e24\u4e2a\u89c6\u89d2\u4e4b\u95f4\u7684\u5dee\u5f02\u5bf9\u4e8e\u4e34\u65f6\u5206\u6790\u6216\u8c03\u8bd5\u4e5f\u975e\u5e38\u6709\u7528\u3002.<\/p>\n

\u8003\u8651\u5230\u8fd9\u4e00\u70b9\uff0c\u5bf9\u4e8e SQL \u4ece\u4e1a\u4eba\u5458\u6765\u8bf4\uff0c\u9884\u7f6e\u548c\u53ef\u91cd\u590d\u4f7f\u7528\u7684\u811a\u672c\u662f\u6709\u610f\u4e49\u7684\uff0c\u8fd9\u4e5f\u662f\u672c\u6587\u7684\u76ee\u7684\u6240\u5728\u3002.<\/p>\n<\/div><\/div><\/div><\/div><\/div>

\u5373\u7528\u578b SQL \u6a21\u677f\u8bf4\u660e<\/h2><\/div>

\u8ba9\u6211\u4eec\u5e26\u7740\u671f\u5f85\u7684\u7591\u95ee\u76f4\u5954\u95ee\u9898\u7684\u6838\u5fc3\uff1a<\/p>\n<\/div>\"Image\"

\u73b0\u5728\uff0c\u8ba9\u6211\u4eec\u6765\u89e3\u91ca\u4e00\u4e0b\uff1a<\/p>\n<\/div>

  • <\/i><\/span>
    \n

    \u9996\u5148\uff0c\u6211\u4eec\u4f7f\u7528 CTE - \u5e38\u7528\u8868\u8868\u8fbe\u5f0f\uff08WITH ... ASstatements\uff09\u6765\u786e\u5b9a\u8981\u6bd4\u8f83\u7684\u4e24\u4e2a data \u96c6\u3002\u56e0\u6b64\uff0c\u4e0b\u9762\u7684\u67e5\u8be2\u884c\u53ef\u4ee5\u4fdd\u6301\u4e0d\u53d8\u3002.<\/p>\n<\/div><\/li>

  • <\/i><\/span>
    \n

    \u7136\u540e\uff0c\u6211\u4eec\u6784\u9020\u4e24\u4e2a\u7c7b\u4f3c\u7684\u67e5\u8be2\uff0c\u522b\u540d\u5206\u522b\u4e3a dataset_1_only \u548c dataset_2_only\uff0c\u4ee5\u4fbf\u4fdd\u7559\u53ea\u5b58\u5728\u4e8e dataset 1 \u4e2d\u7684\u8bb0\u5f55\uff08\u4e0e dataset 2 \u76f8\u6bd4\uff09\uff0c\u53cd\u4e4b\u4ea6\u7136\uff0c\u8fd9\u8981\u5f52\u529f\u4e8e EXCEPT \u96c6\u64cd\u4f5c\u7b26\u3002.<\/p>\n<\/div><\/li>

  • <\/i><\/span>
    \n

    \u6700\u540e\uff0c\u8fd8\u5b9a\u4e49\u4e86\u4e00\u4e2a\u6807\u5fd7\u8865\u5145\u5b57\u6bb5\uff0c\u4ee5\u8bc6\u522b\u4e24\u4e2a\u67e5\u8be2\u4e2d\u4e0d\u5339\u914d\u8bb0\u5f55\u7684\u6765\u6e90\u3002\u7136\u540e\u901a\u8fc7 UNION ALL \u96c6\u5408\u64cd\u4f5c\u7b26\u6536\u96c6\u8fd9\u4e9b\u6570\u636e\u3002.<\/p>\n<\/div><\/li><\/ul>

    \u6ce8\uff1a\u663e\u7136\uff0c\u8981\u4f7f\u7528\u4e0a\u8ff0\u67e5\u8be2\uff0c\u524d\u63d0\u6761\u4ef6\u662f\u8981\u6709\u4e24\u4e2a\u5177\u6709\u53ef\u6bd4\u5b57\u6bb5\u7684 datasets<\/em><\/p>\n<\/div>

    \u56fe\u4f8b<\/h2><\/div>

    \u7406\u8bba\u8bf4\u5b8c\u4e86\uff0c\u73b0\u5728\u8bf4\u8bf4\u5b9e\u8df5\uff01\u5047\u8bbe\u4e00\u5bb6\u8d85\u5e02\u60f3 \u68c0\u7d22\u6240\u6709\u4ea7\u54c1<\/strong> \u6709\u8d44\u683c\u5728\u5355\u4e2a\u8868\u683c\u4e2d\u6309\u661f\u671f\u664b\u7ea7\u7684\u4eba\u6570 \u664b\u5347\u6761\u4ef6<\/strong>.<\/p>\n

    \u4f5c\u4e3a\u521d\u6b65\u58f0\u660e\uff0c\u6211\u4eec\u8ba4\u4e3a\u4ee5\u4e0b\u4ea7\u54c1\u6709\u5e93\u5b58\uff1a<\/p>\n<\/div>\"Image\"

    \u6839\u636e\u7b2c 1 \u5468\u7684\u664b\u5347\u6761\u4ef6\uff1a<\/p>\n<\/div>

    • <\/i><\/span>
      \n

      10% \u6c34\u679c\u3001\u852c\u83dc\u548c\u9999\u8349\u8d27\u67b6\u6298\u6263<\/em><\/p>\n<\/div><\/li><\/ul>

      dataset_1 \u662f\uff1a<\/p>\n<\/div>\"Image\"

      \u7b2c 2 \u5468\uff0c\u664b\u7ea7\u6761\u4ef6\u6f14\u53d8\u4e3a\uff1a<\/p>\n<\/div>

      • <\/i><\/span>
        \n

        10% \u6c34\u679c\u548c\u51b0\u6dc7\u6dcb\u8d27\u67b6\u6298\u6263<\/em><\/p>\n<\/div><\/li>

      • <\/i><\/span>
        \n

        20% \u852c\u83dc\u8d27\u67b6\u6298\u6263<\/em><\/p>\n<\/div><\/li>

      • <\/i><\/span>
        \n

        \u836f\u6750\u8d27\u67b6\u65e0\u6298\u6263<\/em><\/p>\n<\/div><\/li><\/ul>

        data \u7ba1\u9053\u6f14\u8fdb\u751f\u6210 dataset_2\uff1a<\/p>\n<\/div>\"Image\"

        \u4f46\u662f......\u6211\u4eec\u5bf9\u7ed3\u679c\u771f\u7684\u6709\u4fe1\u5fc3\u5417\uff1f\u5178\u578b\u7684\u95ee\u9898\u6709\uff1a<\/p>\n<\/div>

        • <\/i><\/span>
          \n

          \u662f\u5426\u6709\u7f3a\u5931\u6216\u591a\u4f59\u7684\u884c\uff1f<\/p>\n<\/div><\/li>

        • <\/i><\/span>
          \n

          \u5728\u53d7\u5f71\u54cd\u7684\u7530\u5757\u4e0a\u5b9e\u65bd\u7684\u8fdb\u5316\u662f\u5426\u6b63\u786e\uff1f<\/p>\n<\/div><\/li>

        • <\/i><\/span>
          \n

          \u672a\u53d7\u5f71\u54cd\u7684\u7530\u5757\u662f\u5426\u4f1a\u51fa\u73b0\u5012\u9000\uff1f<\/p>\n<\/div><\/li><\/ul>

          \u6ce8\u610f\uff1a\u5373\u4f7f\u901a\u8fc7\u4e00\u4e2a\u5c0f dataset \u7684\u5fae\u4e0d\u8db3\u9053\u7684\u793a\u4f8b\uff0c\u76f4\u89c2\u5730\u56de\u7b54\u4e0a\u8ff0\u95ee\u9898\u4f3c\u4e4e\u5f88\u5bb9\u6613\uff0c\u4f46\u5728\u5b9e\u9645\u4f7f\u7528\u4e2d\uff0c\u6211\u4eec\u901a\u5e38\u4f1a\u9762\u5bf9\u6765\u81ea\u590d\u6742\u67e5\u8be2\uff08\u8f6c\u6362\u3001\u8fde\u63a5\u3001\u805a\u5408\u3001\u7a97\u53e3\u51fd\u6570......\uff09\u7684\u5927\u91cf\u884c\u548c\u5217\uff0c\u8fd9\u5c31\u4f7f\u5f97\u8be5\u67e5\u8be2\u5177\u6709\u4e86\u5b8c\u6574\u7684\u610f\u4e49<\/em><\/p>\n<\/div>

          \u8ba9\u6211\u4eec\u5c1d\u8bd5\u901a\u8fc7\u89e3\u91ca\u5bf9\u6bd4\u67e5\u8be2\u7ed3\u679c\u6765\u56de\u7b54\u8fd9 3 \u4e2a\u95ee\u9898\uff1a<\/p>\n<\/div>\"Image\"

          \u610f\u89c1\uff1a<\/p>\n<\/div>