Jump to content

Talk:Comparison of reference management software

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by 217.237.149.207 (talk) at 11:28, 25 May 2012. The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

WikiProject iconSoftware: Computing List‑class Mid‑importance
WikiProject iconThis article is within the scope of WikiProject Software, a collaborative effort to improve the coverage of software on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
ListThis article has been rated as List-class on Wikipedia's content assessment scale.
MidThis article has been rated as Mid-importance on the project's importance scale.
Taskforce icon
This article is supported by WikiProject Computing (assessed as Low-importance).

Thanks

Many thanks to all authors for collect data and for making this article.
Andreas Gabler 217.237.149.207 (talk) 11:28, 25 May 2012 (UTC)[reply]


Zotero

Great resource.

A few comments: the import table lists the following databases as unsupported by Zotero: Copac, CSA, ISI, Medline, Ovid, PubMed, SciFinder. I believe Ovid, CSA, and PubMed, however, all work with Zotero, as does Copac's experimental interface. And Medline is available via PubMed, Ovid, and Ebsco, all of which are Zotero-compatible. Karikraus 02:14, 16 March 2007 (UTC)[reply]

I also responded to you in the Zotero forums...
Thanks for the clarification. The import table is meant to list file formats which users can manually import, as opposed to sites that can be imported. If some of the site translators use the raw formats, perhaps they should be changed to "partial" & it should be made clear that Zotero can import that file type from a particular set of sites.
This differs from the "database connectivity" section, which is where the individual "site translators" belong.
Copac is a good example of this. They have their own tagged file format, but Zotero doesn't understand it. However, the site is adding COinS, which Zotero can read. If Copac was added to the database connectivity section, there would be a "yes" in it for Zotero. However, there would still be a "no" for the import file format.
Feel free to amend the wiki, though--that's why I put it here, rather than on my own site. --Karnesky 02:29, 16 March 2007 (UTC)[reply]

When Zotero 2.0 becomes official, will it be considered web-based? Also, is there a way to discover market share for user comparison? Aaronchall (talk) 02:29, 18 February 2010 (UTC)[reply]

Zotero 2.0 is official. While references can be displayed online, there is still no mechanism to add them other than to use the Zotero client from within Firefox. I do not think reliable information on marketshare exists (software categories that are more popular than this one have a problem with this & vendors have little reason to advertise accurate information in many cases, so it is not surprising). If you find some, feel free to add it. --Karnesky (talk) 00:45, 11 March 2010 (UTC)[reply]

refworks pricing

Dunno how to reference in wiki but the price is 100$ individual, heres the link http://www.refworks.com/content/path_learn/purchase.asp tis pretty hidden on the site. —The preceding unsigned comment was added by 81.86.134.31 (talk) 00:51, 8 April 2007 (UTC).[reply]

Reference Manager

MODS support

Does someone have a reference (or even a screenshot) showing Reference Manager MODS XML export? --Karnesky 20:05, 25 April 2007 (UTC)[reply]

It is not documented anywhere, so it seems to have been a false entry. --Karnesky 20:09, 1 June 2007 (UTC)[reply]

Import formats

References for the import formats would be useful too. The product seems to conflate file import with database connectivity for PubMed/Medline/etc. --Karnesky 20:08, 25 April 2007 (UTC)[reply]

In particular, can someone cite bibtex support? The other thompson products can't import this & the ftp site shows no filter. --Karnesky 11:44, 24 May 2007 (UTC)[reply]
Again, the program's own documentation and another comparison betray mistaken entries. --Karnesky 20:12, 1 June 2007 (UTC)[reply]

Export formats

Same as Karnesky, I can't find any support for exporting to BibTeX (with RefMan 12.3). I also couldn't find anything in the program's help or on their website. I'm going to correct this entry. --JonathanWilliford (talk) 15:31, 27 October 2011 (UTC)[reply]

Other possible points of comparison

Some of these come from [1]:

  • Documentation
    • Reference manual
    • Tutorial
    • Context-sensitive Help screens
  • Support
    • Free vs. paid
    • mailing lists, forums, etc.
    • upgrade costs
  • Z39.50 searching
  • Duplicate detection
  • Attached documents
    • PDF/Graphics/other
    • Quantity of attachments
  • RSS
  • Subset management
  • unicode support
  • macros
  • keyboard shortcuts
  • relational database vs. flat database vs. flatfile
  • record types
  • subrecord types (e.g. letter in book in a series...)
  • modify and/or add fields
  • mandatory fields
  • spell checker
  • copy a record
  • global corrections
  • import
    • batch
    • subset of batch
  • related items (and the specific type(s) of relation(s) that you can denote)
  • Searching
    • regex
    • boolean, etc. operators
    • natural language
    • specific fields vs some fields vs all fields
  • Rich formatting (super/sub scripts; bold/underline/italics; semantic markup)
  • Miscellaneous
    • User-written plug-in architecture
    • Localization/translation
    • Citation formatting (as opposed to bibliographic formatting) -- in-text (context-sensitive), footnotes, endnotes
    • Store notes, quotations etc.
    • Multi-user or single-user (perhaps a column in the password/network section). This can be inferred from that section but is not explicitly stated
    • User and group bibliographies drawn from the main bibliography
    • CMS integration

Sirfragalot 05:51, 27 June 2007 (UTC)[reply]

--Karnesky 20:08, 1 June 2007 (UTC)[reply]

Realise I'm an anonymous user in this instance, and if you check the IP you'll find it's somewhere at the Queensland University of Technology (qut.edu.au). One point of comparison I think would be immensely valuable is the means by which you can generate a reference (and is not something I noticed elsewhere on this discussion page). What I mean by this for example is that with Bibtex/Latex you can cite in a number of ways, e.g. \cite{}, \citeasnoun{}, \posessivecite{}, as well as citing just the author name, just the year. By contrast citations using Word/Endnote you have a single citation button that generates a specific style of citation. In both instances I believe there is opportunity to add pre and post information that appears (such as a page number of a citation), but these features and how you can create a citation will differ between the different packages available. I will keep an eye on this site over the coming days in case anyone has any comment with regard to this suggestion. —Preceding unsigned comment added by 131.181.251.10 (talk) 10:23, 12 October 2010 (UTC)[reply]

Does the date of first release mean anything?

I had a change reverted because of "lack of space." If space is a premium, why include date of first release in the table? I nominate that for removal.Aaronchall (talk) 03:58, 17 February 2010 (UTC)[reply]

I just noticed this post. I reverted your removal of the column. It appears in other comparisons of reference management software and also in other software comparisons on Wikipedia. It is, at minimum, of historical interest. --Karnesky (talk) 00:41, 11 March 2010 (UTC)[reply]
Well Karnesky, since you're so concerned about space as a premium in the table, I would think you'd consider that column a much more judicious removal. The whole point of such a table is to enable side-by-side comparison. Those interested in length of existence or time of origin can easily find that information by clicking the name and going to the individual page. If space is so tight, let's remove that column, so that other important comparison information that doesn't neatly in a table can be appended in the note column. Note, you also reverted space savings from other columns that waste space with extra unneeded characters. --Aaronchall (talk) 05:21, 11 March 2010 (UTC)[reply]
I agree the point is to enable a comparison. The initial release date is unbiased, quantitative, and discrete. Contrast this to the notes column, which has the potential to be biased, contentious, and arbitrary. At the very least, it is inconsistent. Why mention that Zotero has Word/OO.o Writer plugins when we don't for, say, Endnote (esp. when this information is contained, explicitly, in a lower table)? The former makes for a much better comparison than the latter. I'm almost sorry to have included the Notes column to begin with!
I do not know what "space savings" you refer to. If it was this edit, it is only because it came after your first edit. But note that the space savings there came at the cost of precision: you removed notes that some software had tiered pricing & also removed the differentiation for those products under subscription-based models. The comparison becomes misleading because of this. --Karnesky (talk) 22:01, 11 March 2010 (UTC)[reply]
I believe that since the point of a table is for comparison, and since space is valuable, only valuable information with meaningful differentiation should be included in the table. The date of first release is relatively irrelevant to Wikipedia users seeking to compare software. Perhaps there would be utility for those studying the evolution and competition of software, but that is a specialized academic pursuit. Those looking at the first table are likely to be looking for points of comparison to aid decision making regarding choice of software. I refer people to this page often so that they can see all of their alternatives. Let's improve this page's utility.--Aaronchall (talk) 09:57, 13 March 2010 (UTC)[reply]
I rather like the date of first release column. It is even useful from the perspective of choosing software, since it gives an idea of a given package's history. It is good to know whether something is a Johnny-come-lately, and the first release date is a nice quick metric for that.Avram (talk) 20:05, 13 March 2010 (UTC)[reply]
WP is an encyclopedia & this page should not be limited to merely a consumer-focused aid for selecting software. That being said, it doesn't seem like the column is a strong impediment to selection & I see no reasonable basis to remove it. --Karnesky (talk) 22:04, 14 March 2010 (UTC)[reply]

RSS

I don't know if citation file format is really the best place to include RSS support, but other projects had crammed their support in there. --Karnesky 14:51, 27 June 2007 (UTC)[reply]

I added it in for WIKINDX because another had it there. Whenever I see the heading 'Citation file format' I always have to think a bit about what it means -- some confusion with export format? If it means the file or stream format in which formatted bibliographies can be output to (as opposed to raw, unformatted output to bibtex, Endnote etc.), then RSS belongs here. Sirfragalot 05:58, 28 June 2007 (UTC)[reply]
Perhaps we could cleanup confusion somehow? This is how I'd define the two different categories:
  • export format -- computer readable format for data exchange
  • citation format -- way of storing stylized (APA, MLA, etc.) citations
For most applications, RSS doesn't fit in either of these very well--RSS feeds can only represent a single citation style. Perhaps it belongs in the networking table? --Karnesky 14:21, 28 June 2007 (UTC)[reply]

Re citation/export format confusion. Your suggestion makes sense (HTML, RTF etc then belong with bibtex, Endnote etc. as export formats and then you wouldn't need citation format as you already have citation styles. and, in this case, RSS as a 'computer readable format for data exchange' (XML actually) would belong in 'export format'. Sirfragalot 15:18, 29 June 2007 (UTC)[reply]

With further reflection, I think the current situation (with RSS in citation file formats) is probably the best compromise, as not-networked apps such as BibDesk can produce RSS too.
I think it is useful to differentiate between file formats that can be imported into another database. There is no single standard for citation information in RSS, so import of that format is less trivial than for ant other format listed in the export table. While many RSS generators do not support multiple citation styles the way that HTML, LaTeX, RTF, and Plain text usually do, they usually contain HTML or textual information that is ultimately to be read my humans (rather than imported into some other piece of software). --Karnesky 22:48, 30 July 2007 (UTC)[reply]

Environment

Perhaps something needed to indicate ancillary software required. e.g. refbase, wikindx etc. require a web server, PHP and MySQL. Also, both of these systems are listed as 'web-based' -- anyone looking for a single-user system may end up over-looking these two (and others) not realizing that, with the appropriate ancillary software, they can be run on a desktop machine. Sirfragalot 06:07, 28 June 2007 (UTC)[reply]

I think this is covered in "operating system support." Aigaion, Connotea, refbase, and wikindx all list "yes," whereas the proprietary apps that you can't use on a single-user system (Bibsonomy, CiteULike, and RefWorks) all list "N/A." --Karnesky 14:27, 28 June 2007 (UTC)[reply]

I still think it's confusing for someone who's not familiar with the software or who is not that computer-literate. If you take wikindx as an example, it says it's web-based and runs on all the OSs listed. It doesn't indicate that it can be run by a single user on a desktop machine. Not does it state that in all cases, PHP and MySQL need to be installed. pybliographer, for example, requires python and others may work with different databases or just flat text files. Sirfragalot 15:12, 29 June 2007 (UTC)[reply]


AMEN to what is being said. A comparison page should include the delivery technologies: php/mysql vs. python, etc.

MonteShaffer 00:32, 18 July 2007 (UTC)[reply]

Comparison of wiki software has columns for "programming language" and "data backend." Something similar would probably be a good idea. I was avoiding these at first, as most of the comparison entries are for desktop apps (where it is less of an issue) & half of the webapps are centrally hosted proprietary apps (where things are less relevant to end users & possibly unknown black boxes). Feel free to add these two columns--I've put in a brief description of "web-based" vs "centrally hosted" until someone adds this info. --Karnesky 23:04, 30 July 2007 (UTC)[reply]
Even with this comment I do not understand the difference between "web-based" and "centrally-hosted website". How can a "centrally-hosted website" be NOT "web-based"? User:Oger000 09:55, 27 January 2010 (CET)
Feel free to propose another term to describe web-based software that can be installed on a personal web server. --Karnesky (talk) 13:51, 27 January 2010 (UTC)[reply]

Other software

Other lists and comparison pages make having a WP article a pre-requisite of being on the page. This provides a test of notability, as the product can be challenged through AfD. We have several entries that are red links. Should we keep them (the only reason I haven't done a purge yet is because I like them) or adopt the same criteria for this page too? --Karnesky (talk) 17:20, 5 March 2008 (UTC)[reply]

I've commented them out for now. I'd support the creation or recreation of WP pages for the three products in question & would suggest that they then be uncommented. --Karnesky (talk) 05:31, 5 April 2008 (UTC)[reply]

Software with articles already

  • OO.o Writer
  • MS Word
MS Word from the 2007 version on has a fairly comprehensive bibliography manager. Is there some reason it isn't included here? —Preceding unsigned comment added by Mr Minchin (talkcontribs) 17:21, 17 November 2010 (UTC)[reply]
What about Latex/Bibtex? Zargulon 12:23, 16 August 2007 (UTC)[reply]
Programs that use a bibtex file for storage are already listed. Several of the comparison points can't be applied to something which is essentially a backend/file format. That being said: feel free to try. --Karnesky 13:16, 16 August 2007 (UTC)[reply]
Right--see Bibdesk and JabRef. CHE 21:46, 16 August 2007 (UTC)[reply]
Contrary to the table, Lyx does allow the import of BibTeX databases. Therefore, a separate LyX column beyond the BibTeX column only makes sense for the two databases that do not allow BibTex-Export, namely Scholar's Aid and WizFolio. I have no experience with these two.
That column is for integration with the program (through, e.g. lyxpipes). This allows you to use your reference manager to insert a selected reference into LyX at a particular point in the text. --Karnesky (talk) 16:40, 16 December 2010 (UTC)[reply]

Software without articles

  • I don't have time right now to investigate, but I think www.bibme.org should be added to this page.
  • Maybe it's worth to add also Biborb: biborb.glymn.net

Both of the above were added anonymously (with active urls). I think that this list should be limited to notable software. If someone feels that these are notable, the first step would be to write a WP article on them that asserts notability (so that it won't be deleted). --Karnesky 22:25, 30 July 2007 (UTC)[reply]

Software already included

Yes, indeed, info on Bookends should really be added! see, e.g., http://www.versiontracker.com/dyn/moreinfo/macosx/14137 - 83.77.151.55 (talk) 14:12, 26 June 2008 (UTC)[reply]

Production of Wikipedia-compatible Citation-lists

Two questions.

1) Does anyone know if any of these reference management software packages can generate Wikipedia-compatible citation templates of the "<ref...{cite..." variety?
2) If so, would other editors support adding this information to the table comparing the various packages?

My two cents: it would be a useful addition (maybe add another column) to the comparison table if at least one of these packages supports Wikipedia output styles today. N2e (talk) 16:13, 18 February 2008 (UTC)[reply]

  1. Yes. Zotero and refbase both do (and the latter can be used as a bibliographic manager for MediaWiki sites, allowing automatic building of a citation. Further: any reference manager with a way to make other citation formats can obviously be extended to allow WP citation template (usually fairly easily).
  2. Not at this time. WP:SELF. Zotero already mentions WP support. Perhaps refbase should too, but there's no reason for another column until more reference managers offer it. --Karnesky (talk) 16:33, 18 February 2008 (UTC)[reply]


Database connectivity

The database connectivity table is biased towards the needs of academics in the sciences and tech sectors and so is misleading as to the real capabilities of the applications listed. Going by the table, RefWorks' connectivity looks terrible because (except for PubMed) all it offers falls under the "other" column. Now, I'm not a fan of RefWorks. In fact, I found the Wikipedia article because I was looking at alternatives. But the table ought to be rethought. Here are two columns that could be added, for instance. --Kartavyam (talk) 13:21, 19 March 2008 (UTC)[reply]

Software JSTOR ATLA Religion Database
Aigaion ? ?
BibDesk ? ?
Biblioscape ? ?
BibSonomy ? ?
Bibus ? ?
CiteULike ? ?
Connotea ? ?
EndNote ? ?
JabRef ? ?
ProCite ? ?
Pybliographer ? ?
refbase ? ?
RefDB ? ?
Reference Manager ? ?
RefWorks Yes Yes
Sente ? ?
Wikindx ? ?
Zotero ? ?
Software JSTOR ATLA Religion Database
It is currently limited, but I'd hardly call it 'biased.' We should eventually add MANY more online databases (in addition to ATLA & JSTOR). Feel free to add these! --Karnesky (talk) 15:17, 19 March 2008 (UTC)[reply]
Well "bias" is not necessarily intentional. As for adding columns to the table, is the best thing to just add columns with a bunch of question marks to the article itself? Or should new columns be staged on the discussion page and then moved to the article when they've been filled enough (e.g. > 50%). BTW, the table fragment above was intended for staging, people should feel free to edit it and add what they know. --Kartavyam (talk) 10:57, 20 March 2008 (UTC)[reply]
Ideally, neither: someone would do the leg work of looking up references (such as the other comparisons that this article links to) so that they could complete the other columns. One should not rely on their personal experience testing applications for adding information anyway. Rather than long tables on the talk page (such as the one above), a simple list of the databases that should be added might be more helpful. Perhaps a table would be o.k. on a subpage, but it seems "heavy" for a discussion page & would be harder to track & is unusual to find on other talk pages. If most of the rows can be completed, I think it is fine for their to be question marks in the main article. --Karnesky (talk) 13:32, 20 March 2008 (UTC)[reply]
Well, this ideal scenario is not something I can contribute to, for lack of time. As for personal experience, there's a difference between what somebody who relies on the marketing literature and documentation but does not use the software can tell you and what somebody who actually uses the software can tell you. For instance, yes, RefWorks exports to BibTeX but what the RefWorks people don't tell you is that it does not treat accented characters in a safe way (BibTeX chokes on what is exported by RefWorks) and it creates utterly useless keys to use in \cite commands. I've had to write my own python tool to clean up what RefWorks exports. In effect, this makes the BibTeX export capability of RefWorks useless for people who can't or don't want to deal with cleaning up the mess. This is a piece of information that could materially impact whether someone wants to use RefWorks or not but you don't get that from the literature provided by the company nor from people who perform a mere cursory inspection of the software. Only actual experience with the software will reveal this shortcoming. --Kartavyam (talk) 14:25, 20 March 2008 (UTC)[reply]

Please refer to WP:NOR. I never said we should rely on marketing literature--in many cases, features will be documented by some third party (such as those we link to) that hopefully satisfy WP:RS. --Karnesky (talk) 14:37, 20 March 2008 (UTC)[reply]

I think the databases that are added should not be a function so much of what each software supports, or what its marketing says, but what's potentially useful to various scholars (probably a lot more contentious!). For example, the current list very biased to sciences (pub med, IEEE, arXiv) and not the needs of e.g. Humanities scholars (say ... JSTOR would be a good inclusion there). However until I finish writing my thesis I don't have time to add this so feel free to ignore me. When I'm done I may come back and adjust it if no-one else has in the meantime. (For the record I use Endnote, for my secondary sources only. I'm finding it a bitch especially as I deal with Classics, whose ancient authors need to be cited in a specific way, along with object catalogues and specific abbreviations for special collections, along with the modern secondary sources in the usual styles, but it just cannot support two or more styles of referencing succesfully (it claims to, but implementation wise it sucks)). GermanicusCaesar (talk) 04:50, 6 November 2010 (UTC)[reply]

gPapers

There's an article for the GPapers project but its not listed in this article. I think its worth adding, seeing that its a fully functional OpenSource alternative to some of the more popular ref management software like Papers. Anyone disagree, or should I go ahead and add a row to each of the tables? Bestchai (talk) 21:32, 25 June 2008 (UTC)[reply]

formatting problem

In the main article, the sorting buttons on the "Word Processor Integration" table redirect to the top of the page, instead of re-sorting the table. I don't know how to fiddle these aspects of tables. 83.104.55.73 (talk) 06:50, 24 September 2008 (UTC)[reply]

 Fixed The problem was that papers didn't have anything specified--it is best to explicitly set all cells to some value, even if that value is "{{dunno}}" --Karnesky (talk) 08:59, 24 September 2008 (UTC)[reply]

Mac software not comprehensive yet

We're missing Bookends, the reference software that is occupying the niche that Papers and Sente are trying to get into. Also some free software like iPapers (NB not the same as Papers!) and possibly Cloister. 87.165.204.163 (talk) 16:21, 25 September 2008 (UTC)[reply]

Bookends (software) doesn't exist. As such, I commented out the parts describing it. It may be re-added easily once an article exists. --Karnesky (talk) 00:02, 26 September 2008 (UTC)[reply]

WizFolio

https://www.wizfolio.com/Default.aspx Does anyone have experience with this package?

A new editor has just re-added NoteExpress to the list of products. This is the only item in the list that is a red link. An article on NoteExpress was recently created, but then deleted as WP:CSD#G11 (Blatant advertising). Lacking any third-party commentary on the significance of the NoteExpress software, and since the entry remains a red link, I suggest that it be removed from the list. EdJohnston (talk) 04:20, 17 January 2009 (UTC)[reply]

Sorry my mistake! However, I didn't re-add it, it was there already but it was not removed when the previous reverts were done by RHaworth. I did find the lack of article link odd and when browsing to it later found the delete notice, but I didn't remember to come back and remove it. The.empty.set (talk) 12:43, 19 January 2009 (UTC)[reply]

Does it really provide reference management capability? I did not find any, it is rather general search/CMS software. Can anybody supply a use case for reference management? The initial record was made at 17:33, 8 May 2009 from shared IP address, which is not very trustfull. —Preceding unsigned comment added by Zeliboba7 (talkcontribs)

Vandalism

We need to undo these edits. I did OS. Will need to get to citation styles & word processor support later, unless someone beats me to it. --Karnesky (talk) 21:56, 27 March 2009 (UTC)[reply]

websearch for data record completion as feature?

hi. Very good and helpful overview, thx for that.

May i ask if anyone knows if a search on the web with the data of an existing local record to complete it automatically is supported by any of these (or other) tools?? I tried a few tools but always they offer a form to enter values instead of performing a search with the values in the existing record. - Is it clear what i mean? FlorianKonnertz (talk) 18:16, 13 April 2009 (UTC)[reply]

Linkage to OpenURL

Would be good to have a section that shows which software allows users to link to library's OpenURL. Could be included in database connectivity section Kendric Apple (talk) 02:07, 19 September 2009 (UTC)[reply]

What about object identifiers?

Should the reference management software be compared on the ability to search for full references by giving only DOI, PMID, JSTOR, PMC, ISBN, ISSN or any other (unique) identifier for printed or digital materials? Kazkaskazkasako (talk) 14:40, 27 November 2009 (UTC)[reply]

Full-text searching in PDFs

Would be useful to know which of these support saving personal copies of PDF files of papers (or indeed Postscript files) and then being able to do a fast full-text search through all of them. I know that you can do this with other software too, but it's handy to have it integrated.--greenrd (talk) 15:09, 20 October 2010 (UTC)[reply]

Ability to handle quotations

Many applications allow to work only with a list of references to sources. But often there is need to work with quotations (quoted text). Which applications support this feature? (Something similar to ScrapBook extension.) —Preceding unsigned comment added by 188.163.3.116 (talk) 19:34, 2 November 2010 (UTC) 92.192.122.145 (talk) 20:39, 14 December 2010 (UTC)[reply]

Social citations / reference sharing

Nice article!

I'd like to incorporate this list from List of social software#Social_citations into this article:

Presumably these are all services which include some kind of social bookmarking functionality.

Can anyone more familiar with these systems identify the encyclopedic way to compare the social functionality of ref management software? --Pnm (talk) 19:31, 1 January 2011 (UTC)[reply]


why is noodlebib not included? —Preceding unsigned comment added by 129.186.176.139 (talk) 22:55, 26 January 2011 (UTC)[reply]

More features for comparison

Hi. Great comparison already. I would find it useful to see for the different programs if you can attach files/filepaths with the software and if it scans pdfs to extract reference information. Ben T/C 10:43, 30 July 2011 (UTC)[reply]