Sales and transaction totals by part, grouped by last 24 months - mysql
SELECT det.partNum,
SUM(det.quantity) AS Demand1,
COUNT(det.partNum) AS Call1
FROM details det
JOIN invoice inv ON det.invoice_id = inv.id
WHERE inv.invoice_date
BETWEEN '2015-11-01 00:00:00'
AND '2015-11-31 23:59:59'
GROUP BY partNum
The above sql returns all part numbers, the total number sold (Demand), and the total number of transactions the parts were involved in (Call) for the current month.
What our vendor wants is this information for every part, but also grouped for each of the past 24 months. The csv they are requesting would look like the following (if only viewing the last 3 months):
Part# | Demand1 | Demand2 | Demand3 | Call1 | Call2 | Call3
123 | 0 | 2 | 0 | 0 | 1 | 0
345 | 6 | 3 | 4 | 1 | 2 | 3
Part# 123: 0 transactions this month (Call1) 0 quantity sold (Demand1)
1 transaction last month (Call2) 2 quantity sold (Demand2).
0 transactions two months ago (Call3) 0 quantity sold (Demand3).
Part# 345: 1 transaction this month (Call1) for qty sold of 6 (Demand1)
2 transactions last month (Call2) for qty sold of 3 (Demand2)
3 transactions two months ago (Call3) for qty sold of 4 (Demand3)
Realize that they want this extended out for the past 24 months. Demand1/Call1 are always the current month.
I used the WHERE/BETWEEN statement to show where the date is coming from and to demonstrate how I can get an accurate report of the parts for the current month.
What I can't figure out how to do is to fill Demand and Call for 24 months. And this is the format that the vendor expects the data to be in. This wasn't my choice. Any help in getting this working as expected would be greatly appreciated.
Thanks
EDIT
I removed the sql-server tag. Sorry about that. This is only MySQL.
Also, I'm adding my reply from below...
Looking into DATEDIFF, TIMESTAMPDIFF, and even PERIOD_DIFF. But none actually seem to return what I need. What needs to happen is the first demand column should search for the current month, day 1 (inclusive) through the next month, day 1 (exclusive). The next demand column should search the current month - one month, day 1 (inclusive) through next month - one month, day 1 (exclusive). And each subsequent column should search the same parameters, subtracting an additional month each column. I don't think that can be accomplished with precision simply using DATEDIFF.
I hope that makes sense.
And again, thanks for any help.
If I understood your problem correctly, you can do it like this:
SELECT
det.partNum,
SUM(case when inv.invoice_date >= dateadd(month, -3, #currMonth) and inv.invoice_date < dateadd(month, -2, #currMonth) then det.quantity else 0) AS Demand1,
SUM(case when inv.invoice_date >= dateadd(month, -2, #currMonth) and inv.invoice_date < dateadd(month, -1, #currMonth) then det.quantity else 0) AS Demand2,
...
FROM details det
JOIN invoice inv ON det.invoice_id = inv.id
WHERE
inv.invoice_date >= '2015-11-01 00:00:00' AND inv.invoice_date < '2015-12-01'
GROUP BY partNum
This uses a variable that has the start date of current month to make the SQL more simple. I also changed the where clause, you should really use >= + < with dates instead of between.
This might get you started with Pivot query.
;WITH cte AS
(
SELECT det.partNum,
SUM(det.quantity) AS DemandSum,
COUNT(det.partNum) AS CallCount,
DATEDIFF(MONTH,inv.invoice_date, GETDATE()) + 1 MonthDiff
FROM details det
JOIN invoice inv ON det.invoice_id = inv.id
GROUP BY det.partNum, DATEDIFF(MONTH,inv.invoice_date, GETDATE()) + 1
)
SELECT t.partNum,
[Demand1],[Demand2],[Demand3],[Demand4],[Demand5],[Demand6],[Demand7],[Demand8],[Demand9],[Demand10],[Demand11],[Demand12],
[Demand13],[Demand14],[Demand15],[Demand16],[Demand17],[Demand18],[Demand19],[Demand20],[Demand21],[Demand22],[Demand23],[Demand24],
[Call1],[Call2],[Call3],[Call4],[Call5],[Call6],[Call7],[Call8],[Call9],[Call10],[Call11],[Call12],
[Call13],[Call14],[Call15],[Call16],[Call17],[Call18],[Call19],[Call20],[Call21],[Call22],[Call23],[Call24]
FROM (SELECT DISTINCT partNum FROM cte) t
LEFT JOIN (
SELECT * FROM (
SELECT partNum, DemandSum, CONCAT('Demand',MonthDiff) ColName FROM cte
) c PIVOT (SUM(DemandSum) FOR ColName IN ([Demand1],[Demand2],[Demand3],[Demand4],[Demand5],[Demand6],[Demand7],[Demand8],[Demand9],[Demand10],[Demand11],[Demand12],
[Demand13],[Demand14],[Demand15],[Demand16],[Demand17],[Demand18],[Demand19],[Demand20],[Demand21],[Demand22],[Demand23],[Demand24])
) p
) ds ON ds.partNum = t.partNum
LEFT JOIN (
SELECT * FROM (
SELECT partNum, CallCount, CONCAT('Call',MonthDiff) ColName FROM cte
) c PIVOT (COUNT(CallCount) FOR ColName IN ([Call1],[Call2],[Call3],[Call4],[Call5],[Call6],[Call7],[Call8],[Call9],[Call10],[Call11],[Call12],
[Call13],[Call14],[Call15],[Call16],[Call17],[Call18],[Call19],[Call20],[Call21],[Call22],[Call23],[Call24])
) p
) cc ON cc.partNum = t.partNum
if that's too confusing, you can use the CASE method. I'd do it a little different than the other answer though..
SELECT
det.partNum,
SUM(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 0 then det.quantity else 0 end) AS Demand1,
SUM(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 1 then det.quantity else 0 end) AS Demand2,
SUM(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 2 then det.quantity else 0 end) AS Demand3,
COUNT(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 0 then det.partNum end) AS Call1,
COUNT(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 1 then det.partNum end) AS Call2,
COUNT(case WHEN DATEDIFF(MONTH, inv.invoice_date, GETDATE()) = 2 then det.partNum end) AS Call3
FROM
details det
JOIN invoice inv ON det.invoice_id = inv.id
GROUP BY
det.partNum
you can get the full script for all 24 months here.. SQL Fiddle
Related
SQL Query to find rows that didn't occur this month
I am trying to find the number of sellers that made a sale last month but didn't make a sale this month. I have a query that works but I don't think its efficient and I haven't figured out how to do this for all months. SELECT count(distinct user_id) as users FROM transactions WHERE MONTH(date) = 12 AND YEAR(date) = 2015 AND transactions.status = 'COMPLETED' AND transactions.amount > 0 AND transactions.user_id NOT IN ( SELECT distinct user_id FROM transactions WHERE MONTH(date) = 1 AND YEAR(date) = 2016 AND transactions.status = 'COMPLETED' AND transactions.amount > 0 ) The structure of the table is: +---------+------------+-------------+--------+ | user_id | date | status | amount | +---------+------------+-------------+--------+ | 1 | 2016-01-01 | 'COMPLETED' | 1.00 | | 2 | 2015-12-01 | 'COMPLETED' | 1.00 | | 3 | 2015-12-01 | 'COMPLETED' | 2.00 | | 1 | 2015-12-01 | 'COMPLETED' | 3.00 | +---------+------------+-------------+--------+ So in this case, users with ID 2 and 3, didn't make a sale this month.
Use conditional aggregation: SELECT count(*) as users FROM ( SELECT user_id FROM transactions -- 1st of previous month WHERE date BETWEEN SUBDATE(SUBDATE(CURRENT_DATE, DAYOFMONTH(CURRENT_DATE)-1), interval 1 month) -- end of current month AND LAST_DAY(CURRENT_DATE) AND transactions.status = 'COMPLETED' AND transactions.amount > 0 GROUP BY user_id -- any row from previous month HAVING MAX(CASE WHEN date < SUBDATE(CURRENT_DATE, DAYOFMONTH(CURRENT_DATE)-1) THEN date END) IS NOT NULL -- no row in current month AND MAX(CASE WHEN date >= SUBDATE(CURRENT_DATE, DAYOFMONTH(CURRENT_DATE)-1) THEN date END) IS NULL ) AS dt SUBDATE(CURRENT_DATE, DAYOFMONTH(CURRENT_DATE)-1) = first day of current month SUBDATE(first day of current month, interval 1 month) = first day of previous month LAST_DAY(CURRENT_DATE) = end of current month
if you want to generify it, you can use curdate() to get current month, and DATE_SUB(curdate(), INTERVAL 1 MONTH) to get last month (you will need to do some if clause for January/December though): SELECT count(distinct user_id) as users FROM transactions WHERE MONTH(date) = MONTH(DATE_SUB(curdate(), INTERVAL 1 MONTH)) AND transactions.status = 'COMPLETED' AND transactions.amount > 0 AND transactions.user_id NOT IN ( SELECT distinct user_id FROM transactions WHERE MONTH(date) = MONTH(curdate()) AND transactions.status = 'COMPLETED' AND transactions.amount > 0 ) as far as efficiency goes, I don't see a problem with this one
The following should be pretty efficient. In order to make it even more so, you would need to provide the table definition and and the EXPLAIN. SELECT COUNT(DISTINCT user_id) users FROM transactions t LEFT JOIN transactions x ON x.user_id = t.user_id AND x.date BETWEEN '2016-01-01' AND '2016-01-31' AND x.status = 'COMPLETED' AND x.amount > 0 WHERE t.date BETWEEN '2015-12-01' AND '2015-12-31' AND t.status = 'COMPLETED' AND t.amount > 0 AND x.user_id IS NULL;
Just some input for thought:
You could create aggregated lists of user-IDs per month, representing all the unique buyers in that month. In your application, you would then simply have to subtract the two months in question in order to get all user-IDs that have only made a sale in one of the two months.
See below for query- and post-processing-examples.
In order to make your query efficient, I would recommend at least a 2-column index for table transactions on [status, amount]. However, in order to prevent the query from having to look up data in the actual table, you could even create a 4-column index [status, amount, date, user_id], which should further improve the performance of your query.
Postgres (v9.0+, tested)
SELECT (DATE_PART('year', t.date) || '-' || DATE_PART('month', t.date)) AS d,
STRING_AGG( DISTINCT t.user_id::TEXT, ',' ) AS buyers
FROM transactions t
WHERE t.status = 'COMPLETED'
AND t.amount > 0
GROUP BY DATE_PART('year', t.date),
DATE_PART('month', t.date)
ORDER BY DATE_PART('year', t.date),
DATE_PART('month', t.date)
;
MySQL (not tested)
SELECT (YEAR(t.date) || '-' || MONTH(t.date)) AS d,
GROUP_CONCAT( DISTINCT t.user_id ) AS buyers
FROM transactions t
WHERE t.status = 'COMPLETED'
AND t.amount > 0
GROUP BY YEAR(t.date), MONTH(t.date)
ORDER BY YEAR(t.date), MONTH(t.date)
;
Ruby (example for post-processing)
db_result = ActiveRecord::Base.connection_pool.with_connection { |con| con.execute( db_query ) }
unique_buyers = db_result.map{|e|[e['d'],e['buyers'].split(',')]}.to_h
buyers_dec15_but_not_jan16 = unique_buyers['2015-12'] - unique_buyers['2016-1']
buyers_nov15_but_not_dec16 = unique_buyers['2015-11']||[] - unique_buyers['2015-12']
...(and so on)...
MySQL results by date
Maybe there is a simple fix but I can't seam to figure it out. I'll try my best to explain my situation. I'm working on a MySQL query that will return results within date range (in column A), and for date range - 1 year (in column B). I need to group results by month day and not by year. So I would like to have something like this: 2014 2013 ---------------- 01-01 6 8 01-03 7 0 01-04 4 1 01-08 0 13 01-21 11 7 In my current query (below) I get results like this (because of ELSE in CASE): 2014 2013 ---------------- 01-01 0 8 01-03 7 0 01-04 0 1 01-08 0 13 01-21 0 7 QUERY: SELECT DATE_FORMAT(table.date, '%e.%c.') AS date, (CASE WHEN DATE(table.date) BETWEEN '2014-01-01' AND '2014-02-01' THEN ROUND(SUM(table.field), 2) ELSE 0 END) AS field_2014, (CASE WHEN DATE(table.date) BETWEEN '2013-01-01' AND '2013-02-01' THEN ROUND(SUM(table.field), 2) ELSE 0 END) AS field_2013 FROM table WHERE (DATE(table.date) BETWEEN '2014-05-01' AND '2014-06-01' OR DATE(table.date) BETWEEN '2013-05-01' AND '2013-06-01') GROUP BY DATE_FORMAT(table.date, '%c.%e.') What should I put in ELSE and how can I achieve this functionality? Thank you for your time
You need aggregation functions. I would recommend:
SELECT DATE_FORMAT(t.date, '%e.%c.') AS date,
SUM(CASE WHEN year(t.date) = 2014 THEN ROUND(SUM(t.field), 2) ELSE 0 END) AS field_2014,
SUM(CASE WHEN year(t.date) = 2013 THEN ROUND(SUM(t.field), 2) ELSE 0 END) AS field_2013
FROM table t
WHERE year(t.date) in (2013, 2014) and month(t.date) = 5
GROUP BY DATE_FORMAT(t.date, '%c.%e.');
I would also recommend using the format '%m-%d'. Having the month then the year means that order by will work on the column. Having all the dates be the same width ("05/01" rather than "5/1") better corresponds to your desired output.
MySql how to compare this years month to last years month?
How do I find the department numbers who have produced more than 20% more sales in them this February (as in this year so would use YEAR(CURDATE()) rather than saying "2012") compared to last February as in the year before. The result table should have only one column which contains the department numbers that have produced 20% more sales. If the febraury last year has no sales for "department 2" but sales for this febraury, then 0 * 1.2= 0 so the results would not show "department 2". If the february last year for "department 3" sold one item, and the february this year sold two items, this would be a 1.5 increase which is more than 1.2 so the results should show "department 3". If there were only 3 departments, at most, there should be only 3 rows. Department 2 does not appear because there was 3 sales last february and one sale this february. Department 4 does not appear because there was no sale last february so in terms of maths 0 * 1.2 = 0 so Department 4 would not appear despite there being sales this febraury. Thank you in advance, and hope this is detailed enough.
Try using having as below:
select departement_no
from department
group by departement_no
having sum(case date_format(date, '%m%Y')
when CONCAT('02',YEAR(CURDATE())) then 1 else 0 end)
>
1.2 * sum(case date_form(date, '%m%Y')
when CONCAT('02',YEAR(DATE_SUB(CURDATE(),INTERVAL 1 Year)))
then 1 else 0 end)
AND
sum(case date_form(date, '%m%Y')
when CONCAT('02',YEAR(DATE_SUB(CURDATE(),INTERVAL 1 Year)))
then 1 else 0 end) > 0
This uses MAKEDATE() function to craete the first day of a year and then adds the appropriate month intervals to calculate the start of the (February) month and the start date of the next month. Replace ? with 1 for January, 2 for February, etc.: SELECT this_year.departement_no FROM ( SELECT departement_no, COUNT(*) AS num_sales FROM department WHERE date >= MAKEDATE( YEAR(NOW()), 1) + INTERVAL (?-1) MONTH AND date < MAKEDATE( YEAR(NOW()), 1) + INTERVAL (?) MONTH GROUP BY departement_no ) this_year LEFT JOIN ( SELECT departement_no, COUNT(*) AS num_sales FROM department WHERE date >= MAKEDATE( YEAR(NOW())-1, 1) + INTERVAL (?-1) MONTH AND date < MAKEDATE( YEAR(NOW())-1, 1) + INTERVAL (?) MONTH GROUP BY departement_no ) last_year ON last_year.departement_no = this_year.departement_no WHERE this_year.num_sales > 1.2 * COALESCE(last_year.num_sales, 0) ; If you want (as your rather strange requirements) to not show departments that have sales this February and had no sales last year, remove the COALESCE() function. You can also change the LEFT join to INNER join: WHERE this_year.num_sales > 1.2 * last_year.num_sales ;
showing previous and current month data in table using mysql
I am trying to show three different figures of the same column In a mysql query, I would like to keep one month static: April, so it would be a case like this I want to show The current month, the previous month and the static month of the year I'm working with, in this case let us stick with 2012 Example Tablename:payment id , pay_date, amount 1 2012-02-12 1000 2 2012-03-11 780 3 2012-04-15 890 4 2012-05-12 1200 5 2012-06-12 1890 6 2012-07-12 1350 7 2012-08-12 1450 So what I want to do is show the column amount for the month of April as I said I want to keep that row static: 890, the current month lets say the current month is August:1450 and the previous month amount which would be July:1350: so the final result would be something like this: april_amount current_month_amount previous_month_amount 890 1450 1350 However I'm stuck here: select amount as april_amount from payment where monthname(pay_date) LIKE 'April' and year(pay_date) LIKE 2012 I hope the question is written clear enough, and thanks alot for the help much appreciated.
If the results can be rows instead of columns: SELECT MONTHNAME(pay_date), amount FROM payment WHERE pay_date BETWEEN '2012-04-01' AND '2012-04-30' OR pay_date BETWEEN CURRENT_DATE - INTERVAL DAYOFMONTH(CURRENT_DATE) - 1 DAY AND LAST_DAY(CURRENT_DATE) OR pay_date BETWEEN CURRENT_DATE - INTERVAL DAYOFMONTH(CURRENT_DATE) - 1 DAY - INTERVAL 1 MONTH AND LAST_DAY(CURRENT_DATE - INTERVAL 1 MONTH) See it on sqlfiddle.
I might be way off here. But try: select top 1 p.amount, c.amount, n.amount from payment c inner join payment p ON p.pay_date < c.pay_date inner join payment n ON n.pay_date > c.pay_date where monthname(c.paydate) LIKE 'April' and year(c.pay_date) LIKE 2012 order by p.pay_date DESC, n.pay_date ASC EDIT, I didnt read your question properly. I was going for previous, current, and next month. 1 minute and I'll try again. select top 1 p.amount AS april_amount, c.amount AS current_month_amount, n.amount AS previous_month_amount from payment c inner join payment p ON monthname(p.pay_date) = 'April' AND year(p.pay_date) = 2012 inner join payment n ON n.pay_date > c.pay_date where monthname(c.paydate) = monthname(curdate()) and year(c.pay_date) = year(curdate()) order by n.pay_date ASC This assumes there is only 1 entry per month. Ok, so i haven't written in mysql for a while. here is what worked for your example data: select p.amount AS april_amount, c.amount AS current_month_amount, n.amount AS previous_month_amount from payment AS c inner join payment AS p ON monthname(p.pay_date) LIKE 'April' AND year(p.pay_date) LIKE 2012 inner join payment AS n ON n.pay_date < c.pay_date where monthname(c.pay_date) LIKE monthname(curdate()) and year(c.pay_date) LIKE year(curdate()) order by n.pay_date DESC limit 1 the previous month table joined is counterintuitively named n, but this works. I verified it in a WAMP install. To handle aggregates per month you can use subselects. Performance may suffer on very large tables (millions of rows or more). SELECT SUM( a.amount ) AS april_amount, ( SELECT SUM( c.amount ) FROM payment c WHERE MONTH( c.pay_date ) = MONTH( CURDATE( ) ) ) AS current_month_amount, ( SELECT SUM( p.amount ) FROM payment p WHERE MONTH( p.pay_date ) = MONTH( CURDATE( ) - INTERVAL 1 MONTH ) ) AS previous_month_amount FROM payment a WHERE MONTHNAME( a.pay_date ) = 'April' AND YEAR( a.pay_date ) =2012
MYSQL - get a row for each year, with total sum for each month
I have a table of transactions for purchases. Each transaction has a timestamp and purchase amount (in USD). I'm trying to create some stats from this. I'd like to extract a row for each year that contains the sum for each month in the year. (I'd like months with no transaction to sum to 0 - not omitted.) I know I could just do a plain SELECT of everything and process it in PHP, but I was wondering if it was at all possible to make MySQL do the work and extract the data like I want it? What I'd like to see is rows like: Year, Total_Jan, Total_Feb, ... Total_Dec, Total_Year I am able to get the total per year, but I can't work out how to get the total per month into the same row. SELECT YEAR(dt) as the_year, SUM(mc_gross) AS sum_total FROM transactions GROUP BY the_year
SELECT YEAR(dt) as the_year, SUM(CASE WHEN MONTH(dt) = 1 THEN mc_gross ELSE 0 END) AS Total_Jan, SUM(CASE WHEN MONTH(dt) = 2 THEN mc_gross ELSE 0 END) AS Total_Feb, ... SUM(CASE WHEN MONTH(dt) = 12 THEN mc_gross ELSE 0 END) AS Total_Dec FROM transactions GROUP BY the_year;