Human Generated Data

Title

Untitled (boys at desks in classroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16853

Human Generated Data

Title

Untitled (boys at desks in classroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Classroom 99
School 99
Room 99
Indoors 99
Human 98.8
Person 98.8
Person 98.8
Person 98.3
Person 98
Person 98
Person 97.2
Person 97
Person 96
Person 93.6
Person 92.7
Person 86.4
Person 74.2
Interior Design 73.9
Workshop 73.6
Cafeteria 65.1
Restaurant 65.1
Person 63.6
Furniture 62.1
Bedroom 59.2
Art 58.1

Imagga
created on 2022-02-26

room 69.3
classroom 65.4
restaurant 33.7
table 30.4
people 29.6
man 28.9
male 28.4
office 27.8
business 26.7
building 25.4
interior 24.8
businessman 24.7
person 23
adult 22.9
indoors 22
meeting 21.7
businesswoman 20
cafeteria 19.9
men 19.8
library 19.6
desk 19.1
work 18.1
businesspeople 18
computer 17.6
home 17.6
together 17.5
structure 17.2
shop 17
team 17
professional 17
happy 16.9
working 16.8
hall 16
women 15.8
chair 15.7
corporate 15.5
sitting 15.5
dinner 15.3
worker 15.2
executive 14.9
barbershop 14.8
teamwork 14.8
modern 14.7
indoor 14.6
laptop 14.6
group 14.5
smiling 14.5
colleagues 13.6
dining 13.3
talking 13.3
couple 13.1
service 13
portrait 12.3
lifestyle 12.3
teacher 12.1
mature 12.1
conference 11.7
drink 11.7
food 11.5
smile 11.4
success 11.3
mercantile establishment 11.1
furniture 10.8
party 10.3
senior 10.3
salon 10.3
inside 10.1
20s 10.1
suit 9.9
discussion 9.7
job 9.7
glass 9.3
casual 9.3
presentation 9.3
communication 9.2
new 8.9
lunch 8.8
day 8.6
ethnic 8.6
eat 8.4
manager 8.4
center 8.4
house 8.4
occupation 8.3
meal 8.2
technology 8.2
counter 8
celebration 8
design 7.9
40s 7.8
hotel 7.6
formal 7.6
horizontal 7.5
banquet 7.5
place 7.4
company 7.4
clinic 7.4
successful 7.3
place of business 7.3
kitchen 7.2
decor 7.1
life 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.9
indoor 94.2
person 86.4
table 85.5
window 84.4
people 70.7
black and white 54
furniture 50.7
cluttered 24.2
meal 17.7
shop 14.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.5%
Calm 84.9%
Sad 5.9%
Surprised 2.8%
Confused 2.5%
Happy 1.8%
Angry 0.9%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 37-45
Gender Female, 99.9%
Sad 89.1%
Calm 7.7%
Happy 0.9%
Angry 0.8%
Confused 0.8%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 54-64
Gender Male, 73.2%
Calm 98.8%
Confused 0.3%
Sad 0.2%
Happy 0.2%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 92.7%
Happy 41.7%
Sad 35.8%
Calm 16.6%
Confused 2.1%
Angry 1.4%
Disgusted 1.2%
Surprised 0.8%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people sitting at a table full of food 90.4%
a group of people sitting at a table 88.5%
a group of people sitting at a table with food 88.4%

Text analysis

Amazon

45.

Google

45.
45.