Seamless operability between C++11 and Python
Go to file
Henry Schreiner fd61f5038e
feat: setup.py redesign and helpers (#2433)
* feat: setup.py redesign and helpers

* refactor: simpler design with two outputs

* refactor: helper file update and Windows support

* fix: review points from @YannickJadoul

* refactor: fixes to naming and more docs

* feat: more customization points

* feat: add entry point pybind11-config

* refactor: Try Extension-focused method

* refactor: rename alt/inplace to global

* fix: allow usage with git modules, better docs

* feat: global as an extra (@YannickJadoul's suggestion)

* feat: single version location

* fix: remove the requirement that setuptools must be imported first

* fix: some review points from @wjacob

* fix: use .in, add procedure to docs

* refactor: avoid monkeypatch copy

* docs: minor typos corrected

* fix: minor points from @YannickJadoul

* fix: typo on Windows C++ mode

* fix: MSVC 15 update 3+ have c++14 flag

See <https://docs.microsoft.com/en-us/cpp/build/reference/std-specify-language-standard-version?view=vs-2019>

* docs: discuss making SDists by hand

* ci: use pep517.build instead of manual setup.py

* refactor: more comments from @YannickJadoul

* docs: updates from @ktbarrett

* fix: change to newly recommended tool instead of pep517.build

This was intended as a proof of concept; build seems to be the correct replacement.

See https://github.com/pypa/pep517/pull/83

* docs: updates from @wjakob

* refactor: dual version locations

* docs: typo spotted by @wjakob
2020-09-16 17:13:41 -04:00
.github feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
docs feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
include/pybind11 feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
pybind11 feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
tests feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
tools feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
.appveyor.yml ci: Eigen moved 2020-09-03 14:06:28 -04:00
.clang-tidy style: clang-tidy: default checks and fix bug in iostream deconstruction 2020-09-15 09:56:59 -04:00
.cmake-format.yaml format: apply cmake-format 2020-07-30 20:27:55 -04:00
.gitignore feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
.gitmodules Add .git suffix to URL because only GitHub itself works without it. (#2319) 2020-07-23 13:21:09 -04:00
.pre-commit-config.yaml feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
.readthedocs.yml Fix readthedocs build (#721) 2017-03-12 22:36:48 +01:00
CMakeLists.txt feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
LICENSE docs: contrib/issue templates (#2377) 2020-08-17 10:14:23 -04:00
MANIFEST.in feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
pyproject.toml feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
README.md fix: support NVIDIA-PGI HPC SDK (#2475) 2020-09-11 22:06:52 -04:00
setup.cfg feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00
setup.py feat: setup.py redesign and helpers (#2433) 2020-09-16 17:13:41 -04:00

pybind11 logo

pybind11 — Seamless operability between C++11 and Python

Documentation Status Documentation Status Gitter chat CI Build status

pybind11 is a lightweight header-only library that exposes C++ types in Python and vice versa, mainly to create Python bindings of existing C++ code. Its goals and syntax are similar to the excellent Boost.Python library by David Abrahams: to minimize boilerplate code in traditional extension modules by inferring type information using compile-time introspection.

The main issue with Boost.Python—and the reason for creating such a similar project—is Boost. Boost is an enormously large and complex suite of utility libraries that works with almost every C++ compiler in existence. This compatibility has its cost: arcane template tricks and workarounds are necessary to support the oldest and buggiest of compiler specimens. Now that C++11-compatible compilers are widely available, this heavy machinery has become an excessively large and unnecessary dependency.

Think of this library as a tiny self-contained version of Boost.Python with everything stripped away that isn't relevant for binding generation. Without comments, the core header files only require ~4K lines of code and depend on Python (2.7 or 3.5+, or PyPy) and the C++ standard library. This compact implementation was possible thanks to some of the new C++11 language features (specifically: tuples, lambda functions and variadic templates). Since its creation, this library has grown beyond Boost.Python in many ways, leading to dramatically simpler binding code in many common situations.

Tutorial and reference documentation is provided at pybind11.readthedocs.org. A PDF version of the manual is available here.

Core features

pybind11 can map the following core C++ features to Python:

  • Functions accepting and returning custom data structures per value, reference, or pointer
  • Instance methods and static methods
  • Overloaded functions
  • Instance attributes and static attributes
  • Arbitrary exception types
  • Enumerations
  • Callbacks
  • Iterators and ranges
  • Custom operators
  • Single and multiple inheritance
  • STL data structures
  • Smart pointers with reference counting like std::shared_ptr
  • Internal references with correct reference counting
  • C++ classes with virtual (and pure virtual) methods can be extended in Python

Goodies

In addition to the core functionality, pybind11 provides some extra goodies:

  • Python 2.7, 3.5+, and PyPy (tested on 7.3) are supported with an implementation-agnostic interface.

  • It is possible to bind C++11 lambda functions with captured variables. The lambda capture data is stored inside the resulting Python function object.

  • pybind11 uses C++11 move constructors and move assignment operators whenever possible to efficiently transfer custom data types.

  • It's easy to expose the internal storage of custom data types through Pythons' buffer protocols. This is handy e.g. for fast conversion between C++ matrix classes like Eigen and NumPy without expensive copy operations.

  • pybind11 can automatically vectorize functions so that they are transparently applied to all entries of one or more NumPy array arguments.

  • Python's slice-based access and assignment operations can be supported with just a few lines of code.

  • Everything is contained in just a few header files; there is no need to link against any additional libraries.

  • Binaries are generally smaller by a factor of at least 2 compared to equivalent bindings generated by Boost.Python. A recent pybind11 conversion of PyRosetta, an enormous Boost.Python binding project, reported a binary size reduction of 5.4x and compile time reduction by 5.8x.

  • Function signatures are precomputed at compile time (using constexpr), leading to smaller binaries.

  • With little extra effort, C++ types can be pickled and unpickled similar to regular Python objects.

Supported compilers

  1. Clang/LLVM 3.3 or newer (for Apple Xcode's clang, this is 5.0.0 or newer)
  2. GCC 4.8 or newer
  3. Microsoft Visual Studio 2015 Update 3 or newer
  4. Intel C++ compiler 17 or newer (16 with pybind11 v2.0 and 15 with pybind11 v2.0 and a workaround)
  5. Cygwin/GCC (tested on 2.5.1)
  6. NVCC (CUDA 11 tested)
  7. NVIDIA PGI (20.7 tested)

About

This project was created by Wenzel Jakob. Significant features and/or improvements to the code were contributed by Jonas Adler, Lori A. Burns, Sylvain Corlay, Trent Houliston, Axel Huebl, @hulucc, Sergey Lyskov Johan Mabille, Tomasz Miąsko, Dean Moldovan, Ben Pritchard, Jason Rhinelander, Boris Schäling, Pim Schellart, Henry Schreiner, Ivan Smirnov, and Patrick Stewart.

Contributing

See the contributing guide for information on building and contributing to pybind11.

License

pybind11 is provided under a BSD-style license that can be found in the LICENSE file. By using, distributing, or contributing to this project, you agree to the terms and conditions of this license.