The seakeeping ability of ships is one of the aspects that needs to be assessed during the design phase of ships. Traditionally, potential flow calculations and model tests are employed to investigate whether the ship performs according to specified criteria. With the increase of computational power nowadays, advanced computational tools such as Computational Fluid Dynamics (CFD) become within reach of application during the assessment of ship designs. In the present paper, a detailed validation study of several computational methods for ship dynamics is presented. These methods range from low-fidelity system-based methods, to potential flow methods, to high-fidelity CFD tools. The ability of the methods to predict motions in calm water as well as in waves is investigated. In calm water, the roll decay behavior of a fully appended self-propelled free running 5415M model is investigated first. Subsequently, forced roll motions simulated by oscillating the rudders or stabilizer fins are studied. Lastly, the paper discusses comparisons between experiments and simulations in waves with varying levels of complexity, i.e.regular head waves, regular beam waves and bi-chromatic waves. The predictions for all methods are validated with an extensive experimental data set for ship motions and loads on appendages such as rudders, fins and bilge keels. Comparisons between the different methods and with the experiments are made for the relevant motions and the high fidelity CFD results are used to explain some of the complex physics. The course keeping and seakeeping of the model, the reduction rate of the roll motion, the effectiveness of the fin stabilizers as roll reduction device and the interaction of the roll motion with other motions are investigated as well. The paper shows that only high-fidelity CFD is able to accurately predict all the relevant physics during roll decay, forced oscillation and sailing in waves.