You can see the Drawing Object Properties bar in Writer and Calc. Select the menu View - Toolbars - Drawing Object Properties. The controls are enabled when a drawing object is selected. You see some different icons by default, whether the current document is a text document or a spreadsheet.
Select the thickness for the line. You can append a measurement unit. A zero line thickness results in a hairline with a thickness of one pixel of the output medium.