Parallel scientific computing in C++ and MPI: a seamless approach to parallel algorithms and their implementation

Scientific computing is by its very nature a practical subject- it requires tools and a lot of practice. To solve realistic problems we need not only fast algorithms but also a combination of good tools and fast computers. This is the subject of the current book, which emphasizes equally all three: algorithms, tools, and computers. Often times such concepts and tools are taught serially across different courses and different textbooks, and hence the interconnection between them is not immediately apparent. We believe that such a close integration is important from the outset. The book starts with a heavy dosage of C++ and basic mathematical and computational concepts, and it ends emphasizing advanced parallel algorithms that are used in modern simulations. We have tried to make this book fun to read, to somewhat demystify the subject, and thus the style is sometimes informal and personal. It may seem that this happens at the expense of rigor, and indeed we have tried to limit notation and theorem proofing. Instead, we emphasize concepts and useful tricks-of-the-trade with many code segments, remarks, reminders, and warnings throughout the book. The material of this book has been taught at different times to students in engineering