There are numerous passages in the Bible that speak to this particular question, however there are two that seem to really stick out to me as I began studying this subject. The first that I thought of was in Psalm 19:1-4a. Here is what it says:
The heavens declare the glory of God;
the skies proclaim the work of his hands.
Day after day they pour forth speech;
night after night they display knowledge.
There is no speech or language
where their voice is not heard.
Their voice goes out into all the earth,
their words to the ends of the world.
The subject of that verse is quite clearly "heavens." The English word found here comes from the Hebrew word "shä·mah'·yim," which means "the sky, the atmosphere, the visible universe." So we can very easily discover what the text is saying here, simply that what you see around you "proclaim[s]" the work of God's hands. There isn't a sign up or a signature that says that God created the earth but nonetheless everyday they display the glory of God! The next verse that really caught my eye as particularly relevant, among the many, can be found in Romans 1:18-25, it says:
For the wrath of God is revealed from heaven against all ungodliness and unrighteousness of men, who by their unrighteousness suppress the truth. For what can be known about God is plain to them, because God has shown it to them. For his invisible attributes, namely, his eternal power and divine nature, have been clearly perceived, ever since the creation of the world, in the things that have been made. So they are without excuse. For although they knew God, they did not honor him as God or give thanks to him, but they became futile in their thinking, and their foolish hearts were darkened. Claiming to be wise, they became fools, and exchanged the glory of the immortal God for images resembling mortal man and birds and animals and creeping things.
I found this verse to be particularly complimentary to the verse from Psalm. Where David wrote about how clearly God can be seen in the world Paul touches on the other half of this issue, the idea that even though all of the world points to God we decide as humans that it cannot be that way. "We knew God, [but we] did not honor him as God or give thanks to him." Every day we see evidence of His hand in this world but we still manage to attribute all of the evidence to something else.
The next thing to discuss is the world itself. The world is full of things that point toward God but once again there are a few that stick out at every level of existence, all the way from the micro (really small) level to the macro (really big) level. I'd like to start at the micro level with a protein found in everything that is living called laminin. I think this is best explained by one of the great speakers today, Louie Giglio, here is a video of him talking about it:
So this little molecule called laminin, found at the very core of our being, you can't go any smaller, shows evidence of something greater. Just the proteins and arrangement of DNA is so delicate and arranged in such a way that for all of that to happen by chance is impossible. Than you can look at the human heart. For it to work as it does, with four chambers all beating in an exact pattern at an exact time pumping the exact amount of blood all over your body is a work of art all in itself. But, if you compare that with the human brain, looks like child's play. Our brains are wonders in and of itself. Controlling every aspect of our body and housing our very conscious and keeping our body running autonomously so we can focus on living our lives. But this is only the evidence that presents itself on the macro level. Look around you at the world. The mountains, valleys, storms, rivers, lakes, animals, and beyond all that, the universe. Everything moving and being in such a way that if it was only a little different everything would collapse. Did you know that if the moon was any closer or farther away from the earth that the oceans would overtake the land and we would face a worldwide flood? Did you know that if the earth was only a few inches closer or farther to the sun we would burn or freeze. In fact, as it is, if the universe was much different at all it would cease to exist. All of these things testify to something greater than ourselves and we can know that it is God. We can see God in everything around us and know that it is Him because of what He has told us in the Bible.
In closing, I think it is important to realize just how great our God really is and how much He loves us. God has crafted this world for us with perfect precision and given us the ability to pursue our passions do the things that we like to do. He has created a world that is perfect for us to live and placed it in a universe that always has something new for us to learn about and discover. All He asked is that we worship Him and recognize that it is he that created us and gave us life. The entire world points to Him and we have His words through the Bible to point us to Him even more.