D. Kilfoyle and A. Baggeroer, The State of the Art in Underwater Acoustic Telemetry, IEEE J. of Oceaninc Eng, vol.25, issue.1, pp.4-27, 2000.

E. M. Sozer, M. Stojanovic, and J. G. Proakis, Underwater Acoustic Networks, IEEE J. of Oceanic Eng, vol.25, issue.1, pp.72-83, 2000.

I. F. Akyildiz, D. Pompili, and T. Melodia, Challenges for Efficient Communication in Underwater Acoustic Sensor Networks, SIGBED Rev, vol.1, issue.2, pp.3-8, 2004.

H. Riksfjord, O. T. Haug, and J. M. Hovem, Underwater Acoustic Networks-Survey on Communication Challenges with Transmission Simulations, 2009 Third International Conf. on Sensor Technologies and Applications, pp.300-305, 2009.

M. Stojanovic, S. Shahabudeen, and M. Chitre, Underwater Acoustic Communications and Networking: Recent advances and future challenges, Marine Technology Society J, vol.42, issue.1, 2008.

P. Casari and M. Zorzi, Protocol Design Issues in Underwater Acoustic Networks, Computer Communications, vol.34, pp.2013-2025, 2011.

R. Otnes, A. Asterjadhi, P. Casari, M. Goetz, T. Husoy et al., Underwater Acoustic Networking Techniques, 2012.

E. Felemban, K. Shaikh, U. M. Qureshi, A. A. Sheikh, . Saad-bin et al., Underwater sensor network applications: A comprehensive survey, International J. of Distributed Sensor Networks, vol.11, issue.11, 2015.

B. Peleato and M. Stojanovic, Distance Aware Collision Avoidance Protocol for Ad-Hoc Underwater Acoustic Sensor Networks, IEEE Comm. Letters, vol.11, issue.12, 2007.

Y. Su, Y. Zhu, H. Mo, J. Cui, and Z. Jin, UPC-MAC: A Power Control MAC Protocol for Underwater Sensor Networks, Wireless Algorithms, Systems, and Applications, pp.377-390, 2013.

M. Molins and M. Stojanovic, Slotted FAMA: a MAC protocol for underwater acoustic networks, OCEANS 2006-Asia Pacific, pp.1-7, 2006.

A. A. Syed, W. Ye, and J. Heidemann, T-lohi: A new class of mac protocols for underwater acoustic sensor networks, IEEE INFOCOM 2008-The 27th Conference on Computer Communications, 2008.

P. Qarabaqi and M. Stojanovic, Adaptive Power Control for Underwater Acoustic Communications, Proc. of IEEE OCEANS, 2011.

F. Socheleau, C. Laot, and J. Passerieux, Parametric ReplayBased Simulation of Underwater Acoustic Communication Channels, IEEE J. of Oceaninc Eng, vol.40, issue.4, pp.4838-4839, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01224555

S. Jiang, F. Liu, and S. Jiang, Distance-alignment based adaptive MAC protocol for underwater acoustic networks, 2016 IEEE Wireless Communications and Networking Conference, pp.1-6, 2016.

X. Guo, M. R. Frater, and M. J. Ryan, Design of a Propagation-DelayTolerant MAC Protocol for Underwater Acoustic Sensor Networks, IEEE Journal of Oceanic Engineering, vol.34, issue.2, pp.170-180, 2009.

A. Pottier, F. Socheleau, and C. Laot, Robust Noncooperative Spectrum Sharing Games in Underwater Acoustic Interference Channels, IEEE J. of Oceanic Eng, vol.42, issue.4, pp.1019-1034, 2017.

A. Pottier, F. Socheleau, and C. Laot, Quality-of-Service Satisfaction Games for Noncooperative Underwater Acoustic Communications, IEEE Access, vol.6, pp.2541-2558, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01761481

A. Pottier, F. Socheleau, and C. Laot, Distributed Power Allocation Strategy in Shallow Water Acoustic Interference Channels, IEEE Int. workshop on Signal Processing Advances in Wireless Communications (SPAWC) 2016, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01369655

A. Pottier, F. Socheleau, and C. Laot, Adaptive Power Allocation for Noncooperative OFDM Systems in UWA Interference Channels, Proc. 2nd Underwater Acoustic Communications and Networking Conf. (UComms), 2016.
URL : https://hal.archives-ouvertes.fr/hal-01514722

A. Pottier, F. Socheleau, and C. Laot, Power-Efficient Spectrum Sharing for Noncooperative Underwater Acoustic Communication Systems, MTS/IEEE OCEANS'16 Monterey, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01424511

R. Sutton and A. Barto, Reinforcement Learning: An Introduction, 1998.

J. C. Christopher, P. Watkins, and . Dayan, Q-learning, Machine Learning, vol.8, issue.3, pp.279-292, 1992.

N. Morozs, T. Clarke, and D. Grace, Cognitive spectrum management in dynamic cellular environments: A case-based Q-learning approach, Eng. Applications of Artificial Intelligence, vol.55, pp.239-249, 2016.

Y. Chu, S. Konusalp, P. D. Mitchell, D. Grace, and T. Clarke, Application of reinforcement learning to medium access control for wireless sensor networks, Eng. Applications of Artificial Intelligence, vol.46, pp.23-32, 2015.

S. Konusalp, Y. Chu, P. D. Mitchell, D. Grace, and T. Clarke, Use of Q-learning approaches for practical medium access control in wireless sensor networks, Eng. Applications of Artificial Intelligence, vol.55, pp.146-154, 2016.

V. Divalerio, C. Petrioli, L. Pescosolido, and M. Vandershaar, A Reinforcement Learning-based Data-Link Protocol for Underwater Acoustic Communications, Proc. of the 10th International Conference on Underwater Networks and Systems (WUWNET '15), 2015.

C. Wang, Z. Wang, W. Sun, and D. Fuhrmann, Reinforcement Learning-Based Adaptive Transmission in Time-Varying Underwater Acoustic Channels, IEEE Access, vol.6, pp.2541-2558, 2018.

F. Fazel, M. Fazel, and M. Stojanovic, Random Access Compressed Sensing for Energy-Efficient Underwater Sensor Networks, IEEE J. on Selected Areas in Communications, vol.29, issue.8, pp.1660-1670, 2011.

F. Fazel, M. Fazel, and M. Stojanovic, Random Access Compressed Sensing over Fading and Noisy Communication Channel, IEEE Trans. on Wireless Communications, vol.12, issue.5, pp.2114-2125, 2013.

M. B. Porter, The BELLHOP Manual and Users Guide: Preliminary draft, 2011.

M. Stojanovic, J. G. Proakis, J. A. Rice, and M. D. Green, Spread spectrum underwater acoustic telemetry, OCEANS'98 Conf. Proceedings, vol.2, pp.650-654, 1998.

F. Frassati, C. Lafon, P. Laurent, and J. Passerieux, Experimental assessment of ofdm and dsss modulations for use in littoral waters underwater acoustic communications, Europe, vol.2, pp.826-831, 2005.

P. Qarabaqi and M. Stojanovic, Statistical Characterization and Computationally Efficient Modeling of a Class of Underwater Acoustic Communication Channels, IEEE J. Ocean. Eng, vol.38, issue.4, pp.701-717, 2013.

F. Socheleau, C. Laot, and J. Passerieux, Stochastic Replay of non-WSSUS Underwater Acoustic Communication Channels Recorded at Sea, IEEE Trans. Signal Process, vol.59, issue.10, pp.4838-4849, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00640755

B. Dunshaw, Worldwide Sound Speed, Temperature, Salinity, and Buoyancy from the NOAA World Ocean Atlas