You can use border for table cells, and optionally the border-collapse property to collapse borders.
border
border-collapse
Example: