大きな表形式のデータセットを視覚化して探索する「vaex」のインストールについて解説しています。
「vaex(https://github.com/vaexio/vaex)」は、大規模な表形式データを可視化し、探索するためのPandasに類似した高性能なPythonライブラリです。
■Python
今回のPythonのバージョンは、「3.8.5」を使用しています。(Windows10)(pythonランチャーでの確認)
■vaexをインストールする
vaexをインストールを行いますが、今回はpipを経由してインストールを行うので、まずWindowsのコマンドプロンプトを起動します。
pip install vaex
起動後、上記のコマンドを入力し、Enterキーを押します。
なお、今回は、pythonランチャーを使用しており、Python Version 3.8.5にインストールを行うために、バージョンの切り替えを行います。
py -3.8 -m pip install vaex
切り替えるために、上記のコマンドを入力し、Enterキーを押します。
Defaulting to user installation because normal site-packages is not writeable Collecting vaex Downloading vaex-4.12.0-py3-none-any.whl (4.7 kB) Collecting vaex-server<0.9,>=0.8.1 Downloading vaex_server-0.8.1-py3-none-any.whl (23 kB) Collecting vaex-core<4.13,>=4.12.0 Downloading vaex_core-4.12.0-cp38-cp38-win_amd64.whl (2.0 MB) ---------------------------------------- 2.0/2.0 MB 2.0 MB/s eta 0:00:00 Collecting vaex-jupyter<0.9,>=0.8.0 Downloading vaex_jupyter-0.8.0-py3-none-any.whl (43 kB) ---------------------------------------- 43.2/43.2 kB 2.1 MB/s eta 0:00:00 Collecting vaex-viz<0.6,>=0.5.3 Downloading vaex_viz-0.5.3-py3-none-any.whl (19 kB) Collecting vaex-ml<0.19,>=0.18.0 Downloading vaex_ml-0.18.0-py3-none-any.whl (58 kB) ---------------------------------------- 58.2/58.2 kB 3.0 MB/s eta 0:00:00 Collecting vaex-hdf5<0.13,>=0.12.3 Downloading vaex_hdf5-0.12.3-py3-none-any.whl (16 kB) Collecting vaex-astro<0.10,>=0.9.1 Downloading vaex_astro-0.9.1-py3-none-any.whl (20 kB) Collecting astropy Downloading astropy-5.1-cp38-cp38-win_amd64.whl (6.5 MB) ---------------------------------------- 6.5/6.5 MB 3.5 MB/s eta 0:00:00 Collecting progressbar2 Downloading progressbar2-4.0.0-py2.py3-none-any.whl (26 kB) Collecting pyarrow>=5.0.0 Downloading pyarrow-9.0.0-cp38-cp38-win_amd64.whl (19.6 MB) ---------------------------------------- 19.6/19.6 MB 4.5 MB/s eta 0:00:00 Collecting future>=0.15.2 Using cached future-0.18.2.tar.gz (829 kB) Preparing metadata (setup.py) ... done Collecting cloudpickle Using cached cloudpickle-2.1.0-py3-none-any.whl (25 kB) Requirement already satisfied: six in c:\users\user_\appdata\roaming\python\python38\site-packages (from vaex-core<4.13,>=4.12.0->vaex) (1.16.0) Collecting rich Downloading rich-12.5.1-py3-none-any.whl (235 kB) ---------------------------------------- 235.6/235.6 kB 7.3 MB/s eta 0:00:00 Collecting tabulate>=0.8.3 Using cached tabulate-0.8.10-py3-none-any.whl (29 kB) Collecting pydantic>=1.8.0 Downloading pydantic-1.10.1-cp38-cp38-win_amd64.whl (2.2 MB) ---------------------------------------- 2.2/2.2 MB 4.9 MB/s eta 0:00:00 Requirement already satisfied: pandas in c:\users\user_\appdata\roaming\python\python38\site-packages (from vaex-core<4.13,>=4.12.0->vaex) (1.4.4) Collecting aplus Downloading aplus-0.11.0.tar.gz (3.7 kB) Preparing metadata (setup.py) ... done Requirement already satisfied: numpy>=1.16 in c:\users\user_\appdata\roaming\python\python38\site-packages (from vaex-core<4.13,>=4.12.0->vaex) (1.23.2) Collecting nest-asyncio>=1.3.3 Using cached nest_asyncio-1.5.5-py3-none-any.whl (5.2 kB) Collecting requests Using cached requests-2.28.1-py3-none-any.whl (62 kB) Collecting frozendict!=2.2.0 Downloading frozendict-2.3.4-cp38-cp38-win_amd64.whl (34 kB) Collecting pyyaml Using cached PyYAML-6.0-cp38-cp38-win_amd64.whl (155 kB) Collecting blake3 Downloading blake3-0.3.1-cp38-none-win_amd64.whl (193 kB) ---------------------------------------- 193.7/193.7 kB 5.7 MB/s eta 0:00:00 Collecting filelock Using cached filelock-3.8.0-py3-none-any.whl (10 kB) Collecting dask!=2022.4.0 Downloading dask-2022.9.0-py3-none-any.whl (1.1 MB) ---------------------------------------- 1.1/1.1 MB 7.9 MB/s eta 0:00:00 Collecting h5py>=2.9 Downloading h5py-3.7.0-cp38-cp38-win_amd64.whl (2.6 MB) ---------------------------------------- 2.6/2.6 MB 4.3 MB/s eta 0:00:00 Collecting ipyleaflet Downloading ipyleaflet-0.17.1-py3-none-any.whl (3.4 MB) ---------------------------------------- 3.4/3.4 MB 5.4 MB/s eta 0:00:00 Collecting ipympl Downloading ipympl-0.9.2-py2.py3-none-any.whl (510 kB) ---------------------------------------- 510.3/510.3 kB 5.3 MB/s eta 0:00:00 Collecting ipyvuetify<2,>=1.2.2 Downloading ipyvuetify-1.8.4-py2.py3-none-any.whl (11.7 MB) ---------------------------------------- 11.7/11.7 MB 4.6 MB/s eta 0:00:00 Collecting bqplot>=0.10.1 Downloading bqplot-0.12.36-py2.py3-none-any.whl (1.2 MB) ---------------------------------------- 1.2/1.2 MB 5.2 MB/s eta 0:00:00 Collecting ipyvolume>=0.4 Downloading ipyvolume-0.5.2-py2.py3-none-any.whl (2.9 MB) ---------------------------------------- 2.9/2.9 MB 5.2 MB/s eta 0:00:00 Collecting xarray Downloading xarray-2022.6.0-py3-none-any.whl (927 kB) ---------------------------------------- 927.2/927.2 kB 5.8 MB/s eta 0:00:00 Collecting numba Downloading numba-0.56.2-cp38-cp38-win_amd64.whl (2.5 MB) ---------------------------------------- 2.5/2.5 MB 5.2 MB/s eta 0:00:00 Collecting traitlets Using cached traitlets-5.3.0-py3-none-any.whl (106 kB) Collecting jinja2 Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB) Collecting tornado>4.1 Using cached tornado-6.2-cp37-abi3-win_amd64.whl (425 kB) Collecting fastapi Downloading fastapi-0.81.0-py3-none-any.whl (54 kB) ---------------------------------------- 54.9/54.9 kB 2.8 MB/s eta 0:00:00 Collecting cachetools Downloading cachetools-5.2.0-py3-none-any.whl (9.3 kB) Collecting uvicorn[standard] Downloading uvicorn-0.18.3-py3-none-any.whl (57 kB) ---------------------------------------- 57.4/57.4 kB 3.1 MB/s eta 0:00:00 Collecting pillow Using cached Pillow-9.2.0-cp38-cp38-win_amd64.whl (3.3 MB) Collecting matplotlib>=1.3.1 Downloading matplotlib-3.5.3-cp38-cp38-win_amd64.whl (7.2 MB) ---------------------------------------- 7.2/7.2 MB 4.7 MB/s eta 0:00:00 Collecting ipywidgets<9,>=7.5.0 Downloading ipywidgets-8.0.2-py3-none-any.whl (134 kB) ---------------------------------------- 134.4/134.4 kB 4.0 MB/s eta 0:00:00 Collecting traittypes>=0.0.6 Downloading traittypes-0.2.1-py2.py3-none-any.whl (8.6 kB) Collecting fsspec>=0.6.0 Downloading fsspec-2022.8.2-py3-none-any.whl (140 kB) ---------------------------------------- 140.8/140.8 kB 4.2 MB/s eta 0:00:00 Collecting partd>=0.3.10 Downloading partd-1.3.0-py3-none-any.whl (18 kB) Collecting toolz>=0.8.2 Downloading toolz-0.12.0-py3-none-any.whl (55 kB) ---------------------------------------- 55.8/55.8 kB 3.0 MB/s eta 0:00:00 Collecting packaging>=20.0 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting pythreejs>=1.0.0 Downloading pythreejs-2.4.1-py3-none-any.whl (3.3 MB) ---------------------------------------- 3.3/3.3 MB 5.4 MB/s eta 0:00:00 Collecting ipywebrtc Downloading ipywebrtc-0.6.0-py2.py3-none-any.whl (260 kB) ---------------------------------------- 260.7/260.7 kB 5.4 MB/s eta 0:00:00 Collecting ipyvue<2,>=1.5 Downloading ipyvue-1.7.0-py2.py3-none-any.whl (2.7 MB) ---------------------------------------- 2.7/2.7 MB 5.5 MB/s eta 0:00:00 Collecting cycler>=0.10 Using cached cycler-0.11.0-py3-none-any.whl (6.4 kB) Collecting pyparsing>=2.2.1 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting fonttools>=4.22.0 Downloading fonttools-4.37.1-py3-none-any.whl (957 kB) ---------------------------------------- 957.2/957.2 kB 3.6 MB/s eta 0:00:00 Collecting kiwisolver>=1.0.1 Downloading kiwisolver-1.4.4-cp38-cp38-win_amd64.whl (55 kB) ---------------------------------------- 55.4/55.4 kB 3.0 MB/s eta 0:00:00 Requirement already satisfied: python-dateutil>=2.7 in c:\users\user_\appdata\roaming\python\python38\site-packages (from matplotlib>=1.3.1->vaex-viz<0.6,>=0.5.3->vaex) (2.8.2) Requirement already satisfied: pytz>=2020.1 in c:\users\user_\appdata\roaming\python\python38\site-packages (from pandas->vaex-core<4.13,>=4.12.0->vaex) (2022.2.1) Requirement already satisfied: typing-extensions>=4.1.0 in c:\users\user_\appdata\roaming\python\python38\site-packages (from pydantic>=1.8.0->vaex-core<4.13,>=4.12.0->vaex) (4.3.0) Collecting pyerfa>=2.0 Downloading pyerfa-2.0.0.1-cp38-cp38-win_amd64.whl (366 kB) ---------------------------------------- 366.4/366.4 kB 5.7 MB/s eta 0:00:00 Collecting starlette==0.19.1 Using cached starlette-0.19.1-py3-none-any.whl (63 kB) Collecting anyio<5,>=3.4.0 Using cached anyio-3.6.1-py3-none-any.whl (80 kB) Collecting branca>=0.5.0 Downloading branca-0.5.0-py3-none-any.whl (24 kB) Collecting xyzservices>=2021.8.1 Downloading xyzservices-2022.6.0-py3-none-any.whl (36 kB) Collecting ipython-genutils Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB) Collecting ipython<9 Using cached ipython-8.4.0-py3-none-any.whl (750 kB) Collecting MarkupSafe>=2.0 Using cached MarkupSafe-2.1.1-cp38-cp38-win_amd64.whl (17 kB) Collecting llvmlite<0.40,>=0.39.0dev0 Downloading llvmlite-0.39.1-cp38-cp38-win_amd64.whl (23.2 MB) ---------------------------------------- 23.2/23.2 MB 5.6 MB/s eta 0:00:00 Collecting setuptools<60 Downloading setuptools-59.8.0-py3-none-any.whl (952 kB) ---------------------------------------- 952.8/952.8 kB 6.0 MB/s eta 0:00:00 Collecting importlib-metadata Using cached importlib_metadata-4.12.0-py3-none-any.whl (21 kB) Collecting python-utils>=3.0.0 Downloading python_utils-3.3.3-py2.py3-none-any.whl (23 kB) Collecting charset-normalizer<3,>=2 Using cached charset_normalizer-2.1.1-py3-none-any.whl (39 kB) Collecting urllib3<1.27,>=1.21.1 Downloading urllib3-1.26.12-py2.py3-none-any.whl (140 kB) ---------------------------------------- 140.4/140.4 kB ? eta 0:00:00 Collecting certifi>=2017.4.17 Using cached certifi-2022.6.15-py3-none-any.whl (160 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting pygments<3.0.0,>=2.6.0 Using cached Pygments-2.13.0-py3-none-any.whl (1.1 MB) Collecting commonmark<0.10.0,>=0.9.0 Using cached commonmark-0.9.1-py2.py3-none-any.whl (51 kB) Collecting click>=7.0 Using cached click-8.1.3-py3-none-any.whl (96 kB) Collecting h11>=0.8 Using cached h11-0.13.0-py3-none-any.whl (58 kB) Collecting httptools>=0.4.0 Using cached httptools-0.4.0-cp38-cp38-win_amd64.whl (143 kB) Collecting python-dotenv>=0.13 Downloading python_dotenv-0.21.0-py3-none-any.whl (18 kB) Collecting watchfiles>=0.13 Downloading watchfiles-0.16.1-cp37-abi3-win_amd64.whl (258 kB) ---------------------------------------- 258.2/258.2 kB 5.4 MB/s eta 0:00:00 Collecting websockets>=10.0 Using cached websockets-10.3-cp38-cp38-win_amd64.whl (98 kB) Requirement already satisfied: colorama>=0.4 in c:\users\user_\appdata\roaming\python\python38\site-packages (from uvicorn[standard]->vaex-server<0.9,>=0.8.1->vaex) (0.4.5) Collecting stack-data Downloading stack_data-0.5.0-py3-none-any.whl (24 kB) Collecting matplotlib-inline Downloading matplotlib_inline-0.1.6-py3-none-any.whl (9.4 kB) Collecting jedi>=0.16 Using cached jedi-0.18.1-py2.py3-none-any.whl (1.6 MB) Collecting decorator Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB) Collecting pickleshare Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB) Collecting backcall Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB) Collecting prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 Downloading prompt_toolkit-3.0.31-py3-none-any.whl (382 kB) ---------------------------------------- 382.3/382.3 kB 4.8 MB/s eta 0:00:00 Collecting jupyterlab-widgets~=3.0 Downloading jupyterlab_widgets-3.0.3-py3-none-any.whl (384 kB) ---------------------------------------- 384.1/384.1 kB 4.8 MB/s eta 0:00:00 Collecting widgetsnbextension~=4.0 Downloading widgetsnbextension-4.0.3-py3-none-any.whl (2.0 MB) ---------------------------------------- 2.0/2.0 MB 5.9 MB/s eta 0:00:00 Collecting ipykernel>=4.5.1 Downloading ipykernel-6.15.2-py3-none-any.whl (132 kB) ---------------------------------------- 132.9/132.9 kB 4.0 MB/s eta 0:00:00 Collecting locket Downloading locket-1.0.0-py2.py3-none-any.whl (4.4 kB) Collecting ipydatawidgets>=1.1.1 Downloading ipydatawidgets-4.3.2-py2.py3-none-any.whl (271 kB) ---------------------------------------- 271.6/271.6 kB 17.4 MB/s eta 0:00:00 Collecting zipp>=0.5 Using cached zipp-3.8.1-py3-none-any.whl (5.6 kB) Collecting sniffio>=1.1 Downloading sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting pyzmq>=17 Using cached pyzmq-23.2.1-cp38-cp38-win_amd64.whl (1.1 MB) Collecting debugpy>=1.0 Using cached debugpy-1.6.3-cp38-cp38-win_amd64.whl (4.6 MB) Collecting jupyter-client>=6.1.12 Downloading jupyter_client-7.3.5-py3-none-any.whl (132 kB) ---------------------------------------- 132.1/132.1 kB 3.9 MB/s eta 0:00:00 Collecting psutil Using cached psutil-5.9.1-cp38-cp38-win_amd64.whl (246 kB) Collecting parso<0.9.0,>=0.8.0 Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB) Collecting wcwidth Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB) Collecting pure-eval Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB) Collecting executing Downloading executing-1.0.0-py2.py3-none-any.whl (16 kB) Collecting asttokens Using cached asttokens-2.0.8-py2.py3-none-any.whl (23 kB) Collecting entrypoints Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB) Collecting jupyter-core>=4.9.2 Using cached jupyter_core-4.11.1-py3-none-any.whl (88 kB) Collecting pywin32>=1.0 Using cached pywin32-304-cp38-cp38-win_amd64.whl (12.3 MB) Building wheels for collected packages: future, aplus Building wheel for future (setup.py) ... done Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491058 sha256=628c0a4dc04c596911d2cde03089bfd4e9f29e2238ca8c3297f6f6a957e235c1 Stored in directory: c:\users\user_\appdata\local\pip\cache\wheels\8e\70\28\3d6ccd6e315f65f245da085482a2e1c7d14b90b30f239e2cf4 Building wheel for aplus (setup.py) ... done Created wheel for aplus: filename=aplus-0.11.0-py3-none-any.whl size=4366 sha256=c44111d5f6cdac920909520e4afe9411b582b198d89728ba1dea4c76ae5f9c16 Stored in directory: c:\users\user_\appdata\local\pip\cache\wheels\de\93\23\3db69e1003030a764c9827dc02137119ec5e6e439afd64eebb Successfully built future aplus Installing collected packages: wcwidth, pywin32, pure-eval, pickleshare, ipywebrtc, ipython-genutils, executing, commonmark, blake3, backcall, aplus, zipp, xyzservices, widgetsnbextension, websockets, urllib3, traitlets, tornado, toolz, tabulate, sniffio, setuptools, pyzmq, pyyaml, python-utils, python-dotenv, pyparsing, pygments, pyerfa, pydantic, pyarrow, psutil, prompt-toolkit, pillow, parso, nest-asyncio, MarkupSafe, locket, llvmlite, kiwisolver, jupyterlab-widgets, idna, httptools, h5py, h11, future, fsspec, frozendict, fonttools, filelock, entrypoints, decorator, debugpy, cycler, cloudpickle, click, charset-normalizer, certifi, cachetools, asttokens, uvicorn, traittypes, stack-data, rich, requests, progressbar2, partd, packaging, matplotlib-inline, jupyter-core, jinja2, jedi, importlib-metadata, anyio, xarray, watchfiles, starlette, numba, matplotlib, jupyter-client, ipython, dask, branca, astropy, vaex-core, ipykernel, fastapi, vaex-viz, vaex-server, vaex-ml, vaex-hdf5, vaex-astro, ipywidgets, ipyvue, ipympl, ipyleaflet, ipydatawidgets, bqplot, pythreejs, ipyvuetify, ipyvolume, vaex-jupyter, vaex Attempting uninstall: setuptools Found existing installation: setuptools 62.3.3 Uninstalling setuptools-62.3.3: Successfully uninstalled setuptools-62.3.3 Successfully installed MarkupSafe-2.1.1 anyio-3.6.1 aplus-0.11.0 astropy-5.1 asttokens-2.0.8 backcall-0.2.0 blake3-0.3.1 bqplot-0.12.36 branca-0.5.0 cachetools-5.2.0 certifi-2022.6.15 charset-normalizer-2.1.1 click-8.1.3 cloudpickle-2.1.0 commonmark-0.9.1 cycler-0.11.0 dask-2022.9.0 debugpy-1.6.3 decorator-5.1.1 entrypoints-0.4 executing-1.0.0 fastapi-0.81.0 filelock-3.8.0 fonttools-4.37.1 frozendict-2.3.4 fsspec-2022.8.2 future-0.18.2 h11-0.13.0 h5py-3.7.0 httptools-0.4.0 idna-3.3 importlib-metadata-4.12.0 ipydatawidgets-4.3.2 ipykernel-6.15.2 ipyleaflet-0.17.1 ipympl-0.9.2 ipython-8.4.0 ipython-genutils-0.2.0 ipyvolume-0.5.2 ipyvue-1.7.0 ipyvuetify-1.8.4 ipywebrtc-0.6.0 ipywidgets-8.0.2 jedi-0.18.1 jinja2-3.1.2 jupyter-client-7.3.5 jupyter-core-4.11.1 jupyterlab-widgets-3.0.3 kiwisolver-1.4.4 llvmlite-0.39.1 locket-1.0.0 matplotlib-3.5.3 matplotlib-inline-0.1.6 nest-asyncio-1.5.5 numba-0.56.2 packaging-21.3 parso-0.8.3 partd-1.3.0 pickleshare-0.7.5 pillow-9.2.0 progressbar2-4.0.0 prompt-toolkit-3.0.31 psutil-5.9.1 pure-eval-0.2.2 pyarrow-9.0.0 pydantic-1.10.1 pyerfa-2.0.0.1 pygments-2.13.0 pyparsing-3.0.9 python-dotenv-0.21.0 python-utils-3.3.3 pythreejs-2.4.1 pywin32-304 pyyaml-6.0 pyzmq-23.2.1 requests-2.28.1 rich-12.5.1 setuptools-59.8.0 sniffio-1.3.0 stack-data-0.5.0 starlette-0.19.1 tabulate-0.8.10 toolz-0.12.0 tornado-6.2 traitlets-5.3.0 traittypes-0.2.1 urllib3-1.26.12 uvicorn-0.18.3 vaex-4.12.0 vaex-astro-0.9.1 vaex-core-4.12.0 vaex-hdf5-0.12.3 vaex-jupyter-0.8.0 vaex-ml-0.18.0 vaex-server-0.8.1 vaex-viz-0.5.3 watchfiles-0.16.1 wcwidth-0.2.5 websockets-10.3 widgetsnbextension-4.0.3 xarray-2022.6.0 xyzservices-2022.6.0 zipp-3.8.1
Enterキーを押すと、インストールが開始され、上記のように「Successfully installed」と表示されます。これが表示されると、vaexのインストールが正常に完了となります。
なお、今回はvaexのバージョン4.12.0をインストールしました。
コメント