AWSにPandasライブラリを拡張できるライブラリ「awswrangler」のインストール

AWSにPandasライブラリを拡張できるライブラリ「awswrangler」のインストールについて解説しています。

「awswrangler（https://aws-sdk-pandas.readthedocs.io/en/stable/）」は、Pandasライブラリの機能をAWSに拡張できるライブラリです。

■Python

今回のPythonのバージョンは、「3.8.5」を使用しています。（Windows10）（pythonランチャーでの確認）

■awswranglerをインストールする

awswranglerをインストールを行いますが、今回はpipを経由してインストールを行うので、まずWindowsのコマンドプロンプトを起動します。

pip install awswrangler

起動後、上記のコマンドを入力し、Enterキーを押します。

なお、今回は、pythonランチャーを使用しており、Python Version 3.8.5にインストールを行うために、バージョンの切り替えを行います。

py -3.8 -m pip install awswrangler

切り替えるために、上記のコマンドを入力し、Enterキーを押します。

Defaulting to user installation because normal site-packages is not writeable
Collecting awswrangler
Downloading awswrangler-2.17.0-py3-none-any.whl (251 kB)
---------------------------------------- 251.6/251.6 kB 1.0 MB/s eta 0:00:00
Collecting boto3<2.0.0,>=1.24.11
Downloading boto3-1.26.5-py3-none-any.whl (132 kB)
---------------------------------------- 132.5/132.5 kB 1.5 MB/s eta 0:00:00
Collecting jsonpath-ng<2.0.0,>=1.5.3
Downloading jsonpath_ng-1.5.3-py3-none-any.whl (29 kB)
Collecting pyarrow<8.1.0,>=2.0.0
Using cached pyarrow-8.0.0-cp38-cp38-win_amd64.whl (17.9 MB)
Requirement already satisfied: pymysql<2.0.0,>=1.0.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from awswrangler) (1.0.2)
Collecting gremlinpython<4.0.0,>=3.5.2
Downloading gremlinpython-3.6.1-py2.py3-none-any.whl (73 kB)
---------------------------------------- 73.3/73.3 kB 1.3 MB/s eta 0:00:00
Collecting opensearch-py<3,>=1
Downloading opensearch_py-2.0.0-py2.py3-none-any.whl (204 kB)
---------------------------------------- 204.6/204.6 kB 1.4 MB/s eta 0:00:00
Collecting pg8000<2.0.0,>=1.20.0
Downloading pg8000-1.29.3-py3-none-any.whl (51 kB)
---------------------------------------- 51.3/51.3 kB 2.6 MB/s eta 0:00:00
Collecting redshift-connector<2.1.0,>=2.0.889
Downloading redshift_connector-2.0.909-py3-none-any.whl (112 kB)
---------------------------------------- 112.1/112.1 kB 1.3 MB/s eta 0:00:00
Requirement already satisfied: openpyxl<3.1.0,>=3.0.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from awswrangler) (3.0.10)
Collecting progressbar2<5.0.0,>=4.0.0
Downloading progressbar2-4.2.0-py2.py3-none-any.whl (27 kB)
Collecting botocore<2.0.0,>=1.27.11
Downloading botocore-1.29.5-py3-none-any.whl (9.9 MB)
---------------------------------------- 9.9/9.9 MB 3.3 MB/s eta 0:00:00
Collecting pandas<2.0.0,>=1.2.0
Downloading pandas-1.5.1-cp38-cp38-win_amd64.whl (11.0 MB)
---------------------------------------- 11.0/11.0 MB 5.8 MB/s eta 0:00:00
Collecting requests-aws4auth<2.0.0,>=1.1.1
Downloading requests_aws4auth-1.1.2-py2.py3-none-any.whl (24 kB)
Requirement already satisfied: numpy<2.0.0,>=1.21.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from awswrangler) (1.23.4)
Collecting backoff<3.0.0,>=1.11.1
Downloading backoff-2.2.1-py3-none-any.whl (15 kB)
Collecting s3transfer<0.7.0,>=0.6.0
Downloading s3transfer-0.6.0-py3-none-any.whl (79 kB)
---------------------------------------- 79.6/79.6 kB ? eta 0:00:00
Collecting jmespath<2.0.0,>=0.7.1
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Requirement already satisfied: urllib3<1.27,>=1.25.4 in c:\users\user_\appdata\roaming\python\python38\site-packages (from botocore<2.0.0,>=1.27.11->awswrangler) (1.26.12)
Collecting python-dateutil<3.0.0,>=2.1
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting nest-asyncio
Downloading nest_asyncio-1.5.6-py3-none-any.whl (5.2 kB)
Collecting aiohttp<=3.8.1,>=3.8.0
Using cached aiohttp-3.8.1-cp38-cp38-win_amd64.whl (555 kB)
Requirement already satisfied: isodate<1.0.0,>=0.6.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from gremlinpython<4.0.0,>=3.5.2->awswrangler) (0.6.1)
Collecting aenum<4.0.0,>=1.4.5
Downloading aenum-3.1.11-py3-none-any.whl (131 kB)
---------------------------------------- 131.5/131.5 kB 3.9 MB/s eta 0:00:00
Requirement already satisfied: six in c:\users\user_\appdata\roaming\python\python38\site-packages (from jsonpath-ng<2.0.0,>=1.5.3->awswrangler) (1.16.0)
Collecting ply
Using cached ply-3.11-py2.py3-none-any.whl (49 kB)
Collecting decorator
Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Requirement already satisfied: et-xmlfile in c:\users\user_\appdata\roaming\python\python38\site-packages (from openpyxl<3.1.0,>=3.0.0->awswrangler) (1.1.0)
Requirement already satisfied: requests<3.0.0,>=2.4.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from opensearch-py<3,>=1->awswrangler) (2.28.1)
Requirement already satisfied: certifi in c:\users\user_\appdata\roaming\python\python38\site-packages (from opensearch-py<3,>=1->awswrangler) (2022.9.24)
Requirement already satisfied: pytz>=2020.1 in c:\users\user_\appdata\roaming\python\python38\site-packages (from pandas<2.0.0,>=1.2.0->awswrangler) (2022.4)
Collecting scramp>=1.4.3
Downloading scramp-1.4.4-py3-none-any.whl (13 kB)
Collecting python-utils>=3.0.0
Downloading python_utils-3.4.5-py2.py3-none-any.whl (23 kB)
Collecting beautifulsoup4<5.0.0,>=4.7.0
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting lxml>=4.6.5
Using cached lxml-4.9.1-cp38-cp38-win_amd64.whl (3.6 MB)
Requirement already satisfied: setuptools in c:\users\user_\appdata\roaming\python\python38\site-packages (from redshift-connector<2.1.0,>=2.0.889->awswrangler) (59.8.0)
Requirement already satisfied: packaging in c:\users\user_\appdata\roaming\python\python38\site-packages (from redshift-connector<2.1.0,>=2.0.889->awswrangler) (21.3)
Requirement already satisfied: attrs>=17.3.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from aiohttp<=3.8.1,>=3.8.0->gremlinpython<4.0.0,>=3.5.2->awswrangler) (22.1.0)
Collecting async-timeout<5.0,>=4.0.0a3
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting yarl<2.0,>=1.0
Downloading yarl-1.8.1-cp38-cp38-win_amd64.whl (56 kB)
---------------------------------------- 56.8/56.8 kB 2.9 MB/s eta 0:00:00
Collecting frozenlist>=1.1.1
Downloading frozenlist-1.3.3-cp38-cp38-win_amd64.whl (34 kB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.2-cp38-cp38-win_amd64.whl (28 kB)
Collecting aiosignal>=1.1.2
Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Requirement already satisfied: charset-normalizer<3.0,>=2.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from aiohttp<=3.8.1,>=3.8.0->gremlinpython<4.0.0,>=3.5.2->awswrangler) (2.1.1)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Requirement already satisfied: idna<4,>=2.5 in c:\users\user_\appdata\roaming\python\python38\site-packages (from requests<3.0.0,>=2.4.0->opensearch-py<3,>=1->awswrangler) (3.4)
Collecting asn1crypto>=1.5.1
Downloading asn1crypto-1.5.1-py2.py3-none-any.whl (105 kB)
---------------------------------------- 105.0/105.0 kB 6.3 MB/s eta 0:00:00
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in c:\users\user_\appdata\roaming\python\python38\site-packages (from packaging->redshift-connector<2.1.0,>=2.0.889->awswrangler) (3.0.9)
Installing collected packages: ply, asn1crypto, aenum, soupsieve, scramp, python-utils, python-dateutil, pyarrow, nest-asyncio, multidict, lxml, jmespath, frozenlist, decorator, backoff, async-timeout, yarl, requests-aws4auth, progressbar2, pg8000, pandas, opensearch-py, jsonpath-ng, botocore, beautifulsoup4, aiosignal, s3transfer, aiohttp, gremlinpython, boto3, redshift-connector, awswrangler
Successfully installed aenum-3.1.11 aiohttp-3.8.1 aiosignal-1.3.1 asn1crypto-1.5.1 async-timeout-4.0.2 awswrangler-2.17.0 backoff-2.2.1 beautifulsoup4-4.11.1 boto3-1.26.5 botocore-1.29.5 decorator-5.1.1 frozenlist-1.3.3 gremlinpython-3.6.1 jmespath-1.0.1 jsonpath-ng-1.5.3 lxml-4.9.1 multidict-6.0.2 nest-asyncio-1.5.6 opensearch-py-2.0.0 pandas-1.5.1 pg8000-1.29.3 ply-3.11 progressbar2-4.2.0 pyarrow-8.0.0 python-dateutil-2.8.2 python-utils-3.4.5 redshift-connector-2.0.909 requests-aws4auth-1.1.2 s3transfer-0.6.0 scramp-1.4.4 soupsieve-2.3.2.post1 yarl-1.8.1

Enterキーを押すと、インストールが開始され、上記のように「Successfully installed」と表示されます。これが表示されれば、awswranglerが正常にインストールされたことになります。

なお、今回はawswranglerのバージョン2.17.0をインストールしました。