mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
Mark Smith ([staff profile] mark) wrote in [site community profile] dw_news2009-07-24 07:16 pm

mid-week surprise feature rollout

Hey everybody. This week, we decided to bring you a mid-week news post as we have something kinda exciting to announce:

We've implemented text search for paid users (and all users can search paid communities).

I'll let you read that sentence again... it's a neat sentence. I'm pretty proud of it actually, when you get right down to it. But don't take my word for it! You can test out this feature in your own journal:

http://www.dreamwidth.org/search

And if you want to search through [site community profile] dw_news, you can do so here:

http://www.dreamwidth.org/search?search_user=dw_news

This is currently a beta feature. It's a really new system, and we expect there to be some bumps as we figure out how much load it can take, how big of a server we need, and other unexpected things along the way.

...

Now, let me give the boring details of how we've implemented it right now:

* Search is available for paid user accounts as well as paid communities. Free users are allowed to search through paid communities.

* When searching your journal, you can see all of your posts: public, private, protected, etc. But only you can see them (other people cannot search your journal).

* When searching a community, if you are a member of that community, you can search all posts. If you are not a member, you only see public posts.

* The search index is up to 24 hours behind. This means that when you make a post, it will take up to a full day for that post to appear in the search index. The same goes for edits and deletes.

* Some special characters need to be manually added. I've put in a list of most of the major ones, but if you're using Icelandic or some other more interesting languages, the search may not work so well for you.

...

Well, I think that's it. Go take a look, play around, and see if it works for you. Then come on back and let us know what you think. This is very much a "first draft" of the functionality, but we were just so excited we wanted to push it out for all of you.

For those of you who are curious, this came about because of us being at the Open Source Convention this week. I went to a talk on the Sphinx Open Source search engine where the speaker went over some of the features of the software, how to set it up, and gave a bunch of performance information.

I was really blown away by how easy it looked to get Sphinx working, so I spent that afternoon banging on some code. About ten hours later, I had a working prototype of the search system. Our volunteers spent the night messing with it and coming up with some suggestions and today I spent another six hours refining things and getting it ready for this release.

Reading filters are still in progress (the basic version is up for review!). I hope that you will accept this feature as my way of saying "thanks for waiting!"

And of course, thanks again for using Dreamwidth!
azurelunatic: Azz and best friend grabbing each other's noses.  (Default)

[personal profile] azurelunatic 2009-07-25 03:42 am (UTC)(link)
OMFG SEARCH.
afuna: Cat under a blanket. Text: "Cats are just little people with Fur and Fangs" (Default)

[personal profile] afuna 2009-07-25 03:42 am (UTC)(link)
I LOVE YOU GUYS SO MUCH <33333
lone_lilly: (Default)

<3

[personal profile] lone_lilly 2009-07-25 03:45 am (UTC)(link)
OMG! This was worth staying up late for. I kept thinking, now what would make the site more awesome, that would appeal to me on a personal level?

And um. This was it. *weeps with gratitude*
florahart: (cheerleading)

[personal profile] florahart 2009-07-25 03:50 am (UTC)(link)
I don't have time to play with this now, but OMG SRSLY? Very cool.
theantijoss: (Default)

[personal profile] theantijoss 2009-07-25 03:51 am (UTC)(link)
Wow, that is AWESOME! Wheeee!
delight: basset hound on back (basic doggerel)

[personal profile] delight 2009-07-25 03:53 am (UTC)(link)
OMFG EXCELLENT.
musesfool: gold star christmas ornament (greatness knows itself)

[personal profile] musesfool 2009-07-25 03:53 am (UTC)(link)
Oh, AWESOME.
amokk: (Yin Yang splashed)

[personal profile] amokk 2009-07-25 03:55 am (UTC)(link)
Ok, so [personal profile] zarhooie's hype was accurate. I was just on an lj comm earlier today going "gods, I wish I could search this comm..."
sophie: A cartoon-like representation of a girl standing on a hill, with brown hair, blue eyes, a flowery top, and blue skirt. ☀ (Default)

[personal profile] sophie 2009-07-25 03:59 am (UTC)(link)
But... this doesn't write your masters paper!

;p

(no subject)

[personal profile] amokk - 2009-07-25 04:02 (UTC) - Expand
lassarina: I'm not coming out until the stupid people have gone away.  ....I can wait all day. (Default)

[personal profile] lassarina 2009-07-25 03:58 am (UTC)(link)
You guys are MADE OF EPIC WIN AND SHINIES.

I send you Internets cookies. The yummy kind, not the browser kind.
ilyena_sylph: picture of Labyrinth!faerie with 'careful, i bite' as text (Default)

*YAY!*

[personal profile] ilyena_sylph 2009-07-25 03:59 am (UTC)(link)
Oh, this is awesome!!!
sky: (dgm - komui squee)

[personal profile] sky 2009-07-25 03:59 am (UTC)(link)
OH MY GOD.

YOU HAVE NO IDEA.

HOW MUCH I LOVE DREAMWIDTH RIGHT NOW.

YOU GUYS, NEVER, EVER STOP BEING AMAZING
fjbryan: (heart in sand ILY)

[personal profile] fjbryan 2009-07-25 04:00 am (UTC)(link)
You guys are made of AWE-some.
were_duck: Ellen Ripley from Alien looking pensively to the right in her space helmet (Awesome Sulu)

[personal profile] were_duck 2009-07-25 04:00 am (UTC)(link)
THIS JUST MADE MY EVENING!! YOU ARE THE BEST!
ponderosa: (people - hugh suitporn)

[personal profile] ponderosa 2009-07-25 04:02 am (UTC)(link)
Win! Thanks so much for adding this. How awesome. :D

[personal profile] alittlebirdy 2009-07-25 04:03 am (UTC)(link)
I LURVE YOU! This was my wish on LJ and you just filled it here. *smooch*

question though, can a paid user search a free commmunity? or does the community need to be paid to be searched at all?
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

[staff profile] denise 2009-07-25 04:06 am (UTC)(link)
The community needs to be paid! (Basically, we only index a journal for searching if it's paid.)

Paid users can search their own journals, and anyone (paid or free, members or nonmembers) can search a paid community. Paid users can't search free comms, and nobody can search a personal journal other than their own. We're tossing around ideas about what other circumstances in which to allow search, but we wanted to get the basic version rolled out first.

(Mark literally coded this yesterday, sitting in the lounge at OSCON.)

(no subject)

[personal profile] amokk - 2009-07-25 04:11 (UTC) - Expand

(no subject)

[staff profile] denise - 2009-07-25 04:16 (UTC) - Expand

(no subject)

[personal profile] amokk - 2009-07-25 04:43 (UTC) - Expand

(no subject)

[personal profile] sara - 2009-07-25 04:18 (UTC) - Expand

(no subject)

[staff profile] denise - 2009-07-25 04:25 (UTC) - Expand

(no subject)

[personal profile] john - 2009-07-25 07:14 (UTC) - Expand

(no subject)

[personal profile] alittlebirdy - 2009-07-25 04:18 (UTC) - Expand

(no subject)

[personal profile] archangelbeth - 2009-07-27 00:27 (UTC) - Expand

(no subject)

[personal profile] foxfirefey - 2009-07-27 22:26 (UTC) - Expand
melannen: Commander Valentine of Alpha Squad Seven, a red-haired female Nick Fury in space, smoking contemplatively (Default)

[personal profile] melannen 2009-07-25 04:07 am (UTC)(link)
OH MY GOD.

Thankyouthankyouthankyou: the best new DW feature yet!

I wish I hadn't just given away my extra invites last week: this might be enough to lure over some of my friends who didn't see enough benefits in switching (yet).
darthneko: scampering cat ([personal] scamper)

[personal profile] darthneko 2009-07-25 04:10 am (UTC)(link)
...omg, word alone can not convey the sheer amount of awesome squee. EEEEEEE! I didn't even know I needed it but now that it's there I already don't know how I lived without it! <3<3<3<3
dragonfly: stained glass dragonfly in iridescent colors (Default)

[personal profile] dragonfly 2009-07-25 04:10 am (UTC)(link)
Wow! That works like a dream. *koff* I tried hard to break it, but it worked every time.
libitina: snake across an open book (Default)

[personal profile] libitina 2009-07-25 04:10 am (UTC)(link)
I LOVE YOU GUYS!!!
rahirah: bo the wonder dog (Default)

[personal profile] rahirah 2009-07-25 04:12 am (UTC)(link)
This is AWESOME!!!
lacey: (Dreamwidth- D)

[personal profile] lacey 2009-07-25 04:16 am (UTC)(link)
OMG THANK YOU
sara: S (Default)

[personal profile] sara 2009-07-25 04:16 am (UTC)(link)
HOLY SHABOOLIES, KIDS! THIS IS KIND OF BIGTIME!

(no subject)

[personal profile] sara - 2009-07-25 04:27 (UTC) - Expand
amadi: A stylized photo of two calla lily flowers (Dreamwidth Sheepy!)

[personal profile] amadi 2009-07-25 04:19 am (UTC)(link)
Tre-freakin-mendous!
katekat: (You Rock)

[personal profile] katekat 2009-07-25 04:23 am (UTC)(link)
*bounces* this is AWESOME!!!!!!
xenakis: (xkcdplaypen)

[personal profile] xenakis 2009-07-25 04:25 am (UTC)(link)
My love cannot be textually rendered (but maybe my icon can?)

Page 1 of 4

<< [1] [2] [3] [4] >>