Human Generated Data

Title

Untitled (men playing cards, West Allis, Wisconsin)
Date

1945, printed later
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.954

Human Generated Data

Title

Untitled (men playing cards, West Allis, Wisconsin)

People

Artist: John Deusing, American active 1940s

Date

1945, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Restaurant 99.8
Person 99.8
Human 99.8
Person 99.7
Person 98.9
Person 98.8
Cafe 97.4
Pub 91.1
Meal 90.5
Food 90.5
Bar Counter 88.5
Food Court 83.5
Suit 82.7
Clothing 82.7
Coat 82.7
Overcoat 82.7
Apparel 82.7
Person 82
Cafeteria 81.6
Person 75.3
Person 71.3
Person 60.2

Imagga
created on 2021-12-14

restaurant 52.2
counter 45.4
man 35.6
office 31
people 27.9
male 27.7
table 26
building 25.4
work 25.1
business 23.1
indoors 22.8
cafeteria 21.9
person 20.2
meeting 19.8
sitting 19.8
adult 19.7
professional 19.3
businesswoman 19.1
happy 18.8
working 18.6
businessman 18.5
smiling 18.1
men 18
barroom 17.2
job 16.8
structure 16.8
teamwork 16.7
together 16.6
team 16.1
executive 14.9
holding 14.9
group 14.5
interior 14.1
worker 14
couple 13.9
lifestyle 13.7
suit 13.5
women 13.4
shop 13.2
corporate 12.9
occupation 12.8
presentation 12.1
success 12.1
coffee 12
bar 12
room 11.8
hall 11.8
drink 11.7
portrait 11.6
smile 11.4
talking 11.4
desk 11.3
computer 11.2
food 11.2
happiness 11
conference 10.7
chair 10.6
businesspeople 10.4
education 10.4
senior 10.3
service 10.2
student 10.2
dinner 9.4
alcohol 9.2
meal 9.2
communication 9.2
20s 9.2
modern 9.1
laptop 9.1
chef 8.7
glass 8.6
friends 8.5
library 8.4
horizontal 8.4
color 8.3
employee 8.2
waiter 8.2
indoor 8.2
cheerful 8.1
kitchen 8
nightlife 7.8
colleagues 7.8
books 7.7
dining 7.6
adults 7.6
togetherness 7.6
manager 7.4
camera 7.4
inside 7.4

Google
created on 2021-12-14

Shirt 94.6
Coat 92.8
Drinking establishment 90.6
Black 89.5
Barware 87.8
Black-and-white 84.3
Shelf 82.5
Suit 81.3
Customer 77.1
Monochrome photography 74.7
Monochrome 74.6
Drinkware 72.1
Event 71.7
Room 67.3
Bottle 66.6
Table 64.8
Drink 63.7
Tableware 61.7
Tavern 58.6
Shelving 55.7

Microsoft
created on 2021-12-14

person 99.9
text 98.7
indoor 97.8
table 95.4
black and white 92.8
man 90.4
clothing 85.7
bottle 83.8
restaurant 73.3
people 71.2
furniture 62.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 56.1%
Happy 67.5%
Fear 13.1%
Calm 4.8%
Angry 4.3%
Surprised 3.1%
Sad 2.6%
Confused 2.5%
Disgusted 2.2%

AWS Rekognition

Age 46-64
Gender Male, 85.8%
Calm 96%
Surprised 1.6%
Happy 0.8%
Sad 0.4%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 26-40
Gender Female, 75.4%
Sad 80%
Calm 12.8%
Fear 2.7%
Confused 1.9%
Angry 1.3%
Surprised 0.7%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 29-45
Gender Female, 86.8%
Sad 90.9%
Calm 6.3%
Fear 1.5%
Angry 0.9%
Confused 0.3%
Surprised 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 33-49
Gender Female, 63.3%
Sad 95.9%
Calm 2.6%
Angry 0.7%
Fear 0.6%
Happy 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 82.7%

Captions

Microsoft

a group of people sitting at a table in a restaurant 95.4%
a group of people sitting at a table in front of a restaurant 95.3%
a group of people sitting at a table in front of a store 92.7%

Text analysis

Amazon

38%
P84
671

Google

WARODIED (67) 38% P84
WARODIED
(67)
38%
P84