Human Generated Data

Title

Atlanta (cards and checkers)

Date

1950s

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1936

Human Generated Data

Title

Atlanta (cards and checkers)

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Restaurant 99.9
Human 99.6
Person 99.6
Tie 99.4
Accessories 99.4
Accessory 99.4
Person 99.2
Person 99
Cafeteria 97.5
Person 97.4
Chair 97.4
Furniture 97.4
Chair 97.1
Person 96
Chair 95.4
Person 95.4
Person 94.3
Person 79.3
Food 77.7
Food Court 77.7
Person 74.6
Sitting 73.2
Suit 71.4
Clothing 71.4
Coat 71.4
Overcoat 71.4
Apparel 71.4
Meal 66.5
Cafe 58.3
Person 48.1
Person 42.5

Imagga
created on 2022-01-08

brass 92.9
wind instrument 78.4
musical instrument 54.5
man 34.9
people 34
room 30.7
person 27.3
male 27
classroom 26.8
group 23.4
adult 23
businessman 22.1
business 21.9
home 21.5
happy 21.3
smiling 21
table 20.8
meeting 20.7
office 20.1
indoors 19.3
chair 19.2
men 18.9
professional 18.1
teacher 17.4
businesswoman 17.3
team 17
interior 16.8
executive 16.6
sitting 16.3
lifestyle 15.9
women 15.8
together 15.8
smile 15.7
desk 15.1
education 14.7
laptop 14.6
computer 14.4
couple 13.9
cheerful 13.8
corporate 13.7
family 13.3
work 13.3
working 13.3
teamwork 13
indoor 12.8
businesspeople 12.3
happiness 11.8
boy 11.3
child 11.3
communication 10.9
suit 10.8
colleagues 10.7
kid 10.6
to 10.6
house 10
girls 10
school 10
board 10
attractive 9.8
job 9.7
fun 9.7
student 9.7
class 9.6
workplace 9.5
talking 9.5
expression 9.4
two 9.3
manager 9.3
mature 9.3
worker 9
salon 9
kitchen 8.9
handsome 8.9
diverse 8.8
conference 8.8
looking 8.8
students 8.8
adults 8.5
sit 8.5
casual 8.5
learning 8.5
modern 8.4
study 8.4
leisure 8.3
occupation 8.2
children 8.2
technology 8.2
free-reed instrument 7.8
discussion 7.8
portrait 7.8
partner 7.7
diversity 7.7
exam 7.7
reading 7.6
eating 7.6
friends 7.5
senior 7.5
presentation 7.4
mother 7.4
life 7.4
holding 7.4
inside 7.4
20s 7.3
color 7.2
oboe 7.1

Google
created on 2022-01-08

Chair 90.6
Table 86.4
Snapshot 74.3
Event 73.3
Vintage clothing 70.4
Sitting 70
Recreation 70
Monochrome 68.9
Room 66.9
Class 65.2
Child 64.4
Hat 64.4
Art 63.1
Sharing 61.9
Stock photography 61.9
Monochrome photography 61.8
History 60
Team 59.5
Uniform 59.1
School 54.4

Microsoft
created on 2022-01-08

person 99.5
wall 98.7
sitting 98.6
laptop 97.1
indoor 95.1
clothing 94.1
group 90.6
text 85.2
people 82.3
table 79.5
chair 69.8
man 67.7
furniture 67.2
working 61.4
seated 25.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Female, 93.6%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 82.1%
Confused 13.2%
Sad 1.5%
Disgusted 1.1%
Angry 0.8%
Surprised 0.5%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Female, 100%
Sad 75.4%
Calm 23%
Confused 1%
Angry 0.4%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 46.9%
Angry 21.7%
Sad 18.9%
Confused 6.4%
Disgusted 3%
Surprised 1.1%
Happy 1%
Fear 0.9%

AWS Rekognition

Age 48-54
Gender Male, 100%
Confused 99.6%
Sad 0.2%
Calm 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 98%
Happy 0.5%
Sad 0.5%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 10-18
Gender Female, 99.6%
Calm 95.6%
Sad 3.2%
Angry 0.8%
Fear 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 88.1%
Angry 5.7%
Sad 4.7%
Confused 0.5%
Disgusted 0.4%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 4-10
Gender Female, 99.8%
Angry 34.1%
Sad 25.3%
Calm 19.6%
Fear 9.1%
Surprised 6.5%
Confused 2.7%
Disgusted 1.8%
Happy 0.8%

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Sad 87%
Happy 9.3%
Surprised 1.2%
Fear 0.9%
Calm 0.5%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 89.1%
Sad 6.9%
Confused 1.1%
Surprised 0.9%
Angry 0.7%
Happy 0.5%
Disgusted 0.5%
Fear 0.4%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 67
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 99.4%
Chair 97.4%
Suit 71.4%

Captions

Microsoft

a group of people sitting at a table using a laptop 97.3%
a group of people sitting at a table using a laptop computer 96.6%
a group of people sitting at a table 96.5%

Text analysis

Amazon

Atlanta
Atlanta T.C.
T.C.

Google

Atlanta
Atlanta T.G.
T.G.