Back to Law Journals: Submissions and Ranking database See below for Ranking methodology, Combined-score, Impact-factor, and Cites per Cost IntroductionThe purpose of the Law Journals webpage is to allow authors to find law journals by subject, country, or journal rank (where available), to display journal editorial information, and to facilitate an author's article submission to those journals. Most bar journals, magazines, and newsletters are excluded from this list. Also excluded are law journals that have few English language articles (except for a few U.S. Spanish language and Canadian French language journals). The default listing is alphabetical by journal name. If a rank-order is chosen, by clicking on one or more checkboxes in the center of the menu area, then the list will sort in rank order. Clicking on the column headers for each numeric rank list will re-sort to that rank. Clicking on the "Journal" header above the journal titles column will re-sort alphabetically. It's not necessary, when using the author submission process, to select any of the rank choices, if none is chosen the list defaults to ordering by the most recent combined-score of impact-factor and total cites. If the user selects more than one rank checkbox then the list will rank by the checkbox that is closest to the top, and then closest to the left, of the checkbox choice area. General/Specialized, Country, and Student-edited/Peer-edited/RefereedBy selecting the appropriate checkboxes the journal list may be limited to combinations of:
Journal Subjects
Journal Name Search
Limiting to journals within a Range of Rankings
Impact-Factor Weighting
Checkboxes next to Journal Names
Author Submissions
Exclude Online Journals
Exclude Nonranked
Information About the Journal Ranking MethodologySee also, Impact-Factor, Combined-Score and Cites per Cost Counted citations are those which cite journal volumes published in the preceding eight years. The reason for this limit is to prevent a bias in favor of long-published journals. Thus the study is concerned only with citations to current scholarship. The search results give only the number of citing documents, and do not show where a citing article or case cites to two or more articles in a cited legal periodical. Sources for the citation counts are limited to documents in Westlaw's JLR database (primarily U.S. articles), and in Westlaw's ALLCASES database (U.S. federal/state cases). The searches conducted in those databases generally use the Bluebook format in use in the U.S. (volume journal [page] year), any citations utilizing a non-U.S. legal citation format (year volume journal) would generally not have been counted. Thus it is important to realize that this survey is primarily intended to be a ranking from the perspective of U.S. legal scholarship. The list includes periodicals that began publication after the survey period began. Rank results based on total citation counts are unfair to those periodicals, and whenever a journal recently began publication a warning has been supplied next to the periodical name in the form of a parenthetical date such as "(2001- )". Both impact-factor and combined-score rankings do make an allowance for how recently the journal began publishing. Legal periodicals which appear to have ceased publication (even though they were published during a part of the survey period) are not included.
Anyone wishing to see the text of the searches run in the JLR and ALLCASES databases should look at:
General: 2002, 2003, 2004, 2005, 2006 or Specialized: 2002, 2003, 2004, 2005, 2006 The "Journals" column(s) shows the number of articles that cite to each journal (within our date period) that were found in the full-text Westlaw journals database "Journals and Law Reviews (JLR)". To see what sources are included in the JLR Database see the Westlaw description at directory.westlaw.com/scope/default.asp?db=JLR&RS=WDIR1.0&VR=1.0. The scope note in that Westlaw description describes the JLR content as, "The JLR database contains documents from law reviews, CLE course materials, and bar journals. A document is an article, a note, a symposium contribution, or other materials published in one of the available periodicals". The "Cases" column(s) shows the number of cases that cite to each journal (within our date period) that were found in the full-text Westlaw state and federal case database "Federal & State Case Law (ALLCASES)". To see what sources are included in the ALLCASES Database see the Westlaw description at directory.westlaw.com/scope/default.asp?db=ALLCASES&RS=WDIR1.0&VR=1.0. The scope note in that Westlaw description describes the ALLCASES content as, decisions from the "U.S. Supreme Court, courts of appeals, former circuit courts, district courts, bankruptcy courts, former Court of Claims, Court of Federal Claims, Tax Court, related federal and territorial courts, military courts, the state courts of all 50 states and the local courts of the District of Columbia." Comparisons between the 1999-2006, 1998-2005, 1997-2004, 1996-2003, and 1995-2002 citation counts cannot be made precisely. Although the number of years covered by each ranking column is an identical 7 years and 10 months (the arbitary cut-off date is October 31), the size of the JLR and ALLCASES databases for each of the rotated periods increases by approximately 2%-3% in each later period. Thus, a small percentage increase in the number of documents citing to a journal might be accounted for by an increase in the total number of documents in the database. Searches for citing documents (taking the 1999-2006 period as an example) usually look for citations within the full-text articles/cases that have one of the volume numbers published for the journal from 1999 onwards (i.e. where the journal has labeled the issue as 1999..2006), followed immediately by the journal abbreviation/name, followed within 6 words with a year designation of 1999-2006. A further condition is that any document (case or article) in which such a citation occurs must be dated (in Westlaw's 'date' field) as 1999 onwards, and must have been added to the Westlaw JLR or ALLCASES database subsequent to 1998 and before November 2006. These dates should be adjusted for an explanation of other rotated 8 year periods. As the searches are full-text searches they are naturally prone to some error due to variant citation form in the citing cases/articles. Searches for citation patterns roughly follow the Harvard Blue Book format, usually, VOLUME JOURNAL ... YEAR. Citations that are not in the usual format for legal citations may not have been found. Effort was made to allow for different forms of journal name citations (e.g. allowing for the ALWD citation format) but not all can be retrieved. The citation counts for citations to non-U.S. periodicals are likely to be less accurate than those for U.S. periodicals because non-U.S. legal citation formats are often severely abbreviated (e.g. the International Journal of Evidence and Proof says that it should be cited as, "(2004) 8 E & P"), and may have the date reversed (from the U.S. citation perspective) to first position in the citation string. Articles utilizing non-U.S. citation formats are most usually found in non-U.S. journals, and as there are relatively few non-U.S. journals in the JLR database this is not a severe problem, particularly as the intent of this survey is to rank journals based on U.S. citations. Nevertheless, it should be recognized that if the searches for non-U.S. citations were run in the alternative with year rotated to first position (as in "(2003) 119 L.Q.R.") then more citations would often be found.
Westlaw's treatment of periods and spaces within character strings is difficult to understand and is part of the reason why so many alternate cite forms were used.
The combined-score is a composite of each journal's impact-factor and total cites count. The combined-score is, by default, weighted with a little more emphasis given to impact-factor than to total cites. The resulting score is normalized.
The formula for obtaining the combined-score is the addition of the weighted and normalized scores for each of impact-factor (IF) and total cites (TC): Users may alter the default weight (0.49) by entering any decimal number between 0 and 1. If "0" is entered then the combined-score ranking will ignore impact-factor and produce a normalized ranking by total cites, and if "1" is entered then the combined-score ranking will ignore total cites and produce a normalized ranking by impact-factor. It's recommended that users not change the weighting value unless there's an interest in seeing a normalized ranking for either impact-factor or total cites.
Combined-score ranking is based on the idea proposed by Ronen Perry that neither ranking by total cites nor by impact-factor are in themselves sufficient, and need to be combined. See, "The Relative Value of American Law Reviews: Refinement and Implementation" available at SSRN: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=897063 (published in the Connecticut Law Review). The problem in any combined ranking is what weight to give to the underlying factors. Perry calculated the impact-factor/total-cites weight based on the assumption that Harvard Law Review and Yale Law Journal have equal prestige. His calculation of 0.577 was based on the impact-factor methodology in use by this website prior to September 2007. Since that date a more subtle measure of impact-factor has been used and the default impact-factor weight used on this website is 0.49.
In order to determine what weight to use, data was gathered for Harvard Law Review, Yale Law Journal and Columbia Law Review for 12 survey periods of 8 years each, i.e. for the years 1988-95, 1989-96, ..., 1999-06. The ideal weight would be one that in each survey period keeps Harvard Law Review at a normalized combined score of 100 (Harvard being widely regarded as the gold-standard for law reviews) while maximizing the score for Yale over those 12 survey periods. However, an entirely clear candidate weight could not be found. Broadly, Harvard is favored by a lower impact-factor weight, and Yale is favored by a higher weight. Across a weight range of 0 - 0.25 Harvard keeps a combined rank of 100. However, selecting a weight that low disadvantages Yale which has a median combined score of 88.1 at 0.25 versus a score of 94.2 at, for example, a 0.5 weight. At a weight range of 0.26 - 0.47 Yale scores higher than Harvard in one of the survey periods, for 0.48 - 0.49 Yale scores higher in two survey periods, and for 0.5 - 0.54 Yale scores higher in two survey periods and Columbia scores higher in a third survey period.
The pattern for Yale is a steady rise in median combined score as the weight rises, peaking first with a combined score of 94.5 at a weight of 0.53, its median combined score then dips for a while and rises higher after the weight becomes greater than 0.59. The most satisfactory choices for a weight are then:
95-02 94-01 93-00 92-99 91-98 90-97 89-96 88-95
Impact-factor
Harv 2.23 2.23 2.46 2.23 2.16 2.12 2.09 2.02
Yale 2.39 2.39 2.35 2.28 2.58 2.42 2.18 2
Columb 2.9 2.81 2.58 2.64 2.33 2.18 1.85 1.85
Total Cites To Journal
Harv 6751 7072 7353 7533 7335 7081 6964 6508
Yale 5901 5990 5973 6205 6932 6312 5905 5498
Columb 5226 5345 4968 5059 4925 4562 4148 4074
In order to more fairly compare new journals with established journals an adjustment to the combined-score is made for journals which, at the survey date, have been in existence for more than the then current year but for less than 8 years. For example a journal that began in 2004 will, for the 2006 ranking, have its total cites multiplied by 7.3 (that total cites extrapolation does not display in the total cites column - it is used only in the combined-score formula). The aim is to estimate from the cites to a journal over its few years of life how many cites the journal would likely have had if it had been in existence for 8 years. The multipliers are as follows (where the digit before the parenthical is the difference between the survey year and the year the journal began): 1(29) 2(7.3) 3(3.4) 4(2.3) 5(1.6) 6(1.3). A webpage is available that shows for each law journal how many total cites to an article would have to occur over the following 8 years in order to make such an article worth publishing (from a combined-score ranking point of view). For the Yale Law Journal, for example, the number is '9', so in other words, if it's "known" that an article/note/review/introduction/obit... will receive less than a total of 9 cites during the 8 years after it's published then publishing the item will reduce Yale Law Journal's combined-score (see, http://lawlib.wlu.edu/LJ/citesneeded.aspx). Note, however, that because ranking is based on rounding to one decimal place, small changes in combined-score may not change a journals actual ranking. Impact-FactorImpact-factor shows the average number of citations to articles in each journal (rounded to one decimal place). Impact-factor rankings should be used cautiously as they are biased against journals that publish a larger number of shorter articles, such as book reviews. Nevertheless, if two legal journals have a similar composition of articles, notes, and book reviews, then from an author's viewpoint it's reasonable to compare the impact-factor of each to see which is a better journal with which to publish. The implication of a similar ranking by total citations, but a dissimilar ranking by impact-factor is that the journal ranked lower by impact-factor is publishing some articles of lesser quality, or of less general interest. It's suggested that in preference to using impact-factor, the combined-score ranking (a weighting of both impact-factor and total cites) offers a more balanced view of journal ranking. Note that the methodology for calculating impact-factor produces a volatile measure for journals that have large changes in the number of articles that they publish from year to year. This is because there are usually fewer cites to recent volumes than to older volumes, but the numbers of articles published in those recent volumes are given equal weight in the formula with articles published 7 or 8 years earlier. Just to illustrate, take a hypothetical example of a journal publishing 8 volumes during 1998-2005 and during that period the oldest volume had 2100 cites and that each subsequent volume had 300 fewer cites (the current volume receiving zero cites we'll assume because it's too recent to have been cited in the published literature) - the total cites to all the volumes would be 8400. If each volume published 100 articles, then the journal's impact-factor would be 10.5 (8400/800). In the following year's cycle (1999-2006) assume again that the oldest volume receives 2100 cites dropping again by 300 for each volume (down to zero cites to the most recent volume), but then suppose that the journal increased its output to 150 articles in its most recent volume instead of the usual 100, then its impact-factor would decline from 10.5 to 9.9 (8400/(700+150)). If the journal instead had reduced its output to 50 articles in its most recent volume then its impact-factor would have increased from 10.5 to 11.2 (8400/(700+50)). Such an impact-factor fluctuation from 2005 to 2006 has no basis in any quality change in the journal as it's caused by an increase or decrease in numbers of articles where those articles are too recently published to be significantly cited. As delayed production can have a significant impact on impact-factor - in the above example a zero output for the current year would increase the impact-factor from 10.5 to 12 (8400/700) - an amelioration is introduced into the article count by estimating the number of expected articles for the currently expected year of publication. See below for the actual method used to extrapolate article counts from a 7 year (not 8 year) base period. The formula for determining impact-factor is complicated by the fact that the citation data extracted from Westlaw's JLR database covers a seven year and ten month period - October 31st of each year being the somewhat arbitrar cut-off date for the study. However, the count of the number of articles published by each journal is for volumes dated during the previous seven years. Thus for the November 2006 survey the number of citations occur from the period 1999 through the end of October 2006, whereas the count of articles published in each journal is for 1999-2005. So the formula to determine impact-factor extrapolates the article count by adding 10/12ths of each journal's average year's article count. To obtain an average yearly article count it's necessary to adjust for the number of years that a journal has been in existence if it began publication less than seven years prior to 2006. Thus the formula process is:
The basic methodological difficulty is one of determining the number of articles published by each journal for the date period, there being no completely satisfactory and automated method for doing this. Most of the article quantity data (at least for the higher ranked journals) was obtained from the WilsonWeb Index to Legal Periodicals. "Articles" meaning any entry that ILP indexes, such as forewords, letters, notes, book reviews, as well as more traditional articles. Note that ILP has had different inclusion policies for its indexing over the years: up to the year 1999 items with less than 5 pages were not included. Then through the year 2002 items with less than 2 pages were not included, and in subsequent years items with less than half a page were not included. After the first preference of ILP, if it was necessary to check journals or volumes in other databases, then the next preference was Westlaw (if Westlaw comprehensively added articles for the years needed), followed by Lexis, then Legal Resource Index, then Legal Journals Index (UK), then any other index in which the journal was indexed. Sometimes a manual count was made by physically examining the tables of contents for the journal years needed. In cases where indexing was not available and a manual count was not feasible, then an extrapolation was made from what was known. As these variant sources undoubtedly have differing definitions as to what is a countable entity this introduces variability into the counts. Look at the data files, General: 2002, 2003, 2004, 2005, 2006 or Specialized: 2002, 2003, 2004, 2005, 2006 to see what databases were used to count the number of published articles for each journal, what the counts for each year were, and which ones were estimates. Cites per CostThe Cites per Cost ranking is the average yearly number of cites to the journal divided by the annual US$ cost to U.S. academic libraries. So e.g., a journal with 600 cites per annum and costing $60 would show '10' in the Cites per Cost column.
Journals that are free are ignored for the purpose of this ranking. Strictly they should have an infinite score (cites/0) and be at the top of the ranking, however the purpose of this ranking is to present a cost-effective analysis for purchasing decisions, so ranking free journals seems to counter that purpose. "Average yearly number of cites" is the yearly average of cites as determined by the law journal rankings in the law journal submission information data, and its inclusion methodology (described further above) should be kept in mind. Because of the quirky 7 year and 10 month period used for that data, the cites numerator is calculated by multiplying average cites per month by 12. The year the journal began publication is also considered for recently started journals. So the actual calculation is: To see the cost for law journals you can go to http://lawlib.wlu.edu/selecting.aspx which is a webpage that fits journals (ranked by cites/cost) into a user-supplied budget amount. Note that the list only includes all U.S. journals but only selected non-U.S. journals (having at least a total of 30 cites recorded for the 8 year survey period). One idiosyncracy to note is that (at Georgetown Law Journal's request) cites to Geo. L.J. and the separately published Geo. L.J. Annual Review of Criminal Procedure are merged in the ranking under "Georgetown Law Journal" - consequently the costs for both publications are added into the denominator of the cites/cost calculation. |
|||||||||||||||||||