Human Generated Data

Title

Untitled (large group of firemen seated around table)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15118

Human Generated Data

Title

Untitled (large group of firemen seated around table)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Furniture 100
Chair 100
Human 98.1
Person 98.1
Person 98
Person 97.8
Person 95.4
Restaurant 94.8
Person 93.8
Person 91.2
Person 91.1
Sitting 89.8
Interior Design 88.7
Indoors 88.7
Person 87.6
Text 84.5
Person 83.1
Cafeteria 82.5
Cafe 80.6
Room 75.8
Meal 73.1
Food 73.1
Person 68.6
People 68.5
Floor 63
Table 60.8
Chair 60.6
Apparel 60
Clothing 60
Flooring 59.9
Couch 56.9
Female 55.6

Imagga
created on 2022-03-05

barbershop 43.3
shop 37
businessman 31.8
office 31.4
business 31
room 30.8
man 30.2
newspaper 29.1
male 28.4
mercantile establishment 27.3
people 25.7
person 22.9
meeting 22.6
product 22.3
classroom 21.1
adult 20.9
corporate 20.6
men 18.9
desk 18.9
place of business 18.2
group 17.7
building 17.7
indoors 17.6
creation 17.3
communication 16.8
professional 16.4
teacher 16.1
team 16.1
job 15.9
table 15.6
laptop 15.5
smiling 15.2
women 15
work 14.9
indoor 14.6
businesswoman 14.5
happy 14.4
talking 14.3
computer 13.6
suit 13.5
modern 13.3
interior 13.3
executive 13.1
teamwork 13
conference 12.7
worker 12.3
together 12.3
manager 12.1
sitting 12
chair 11.9
discussion 11.7
colleagues 11.7
restaurant 11.6
couple 11.3
employee 11.3
education 11.3
mature 11.2
working 10.6
businesspeople 10.4
boss 9.6
career 9.5
casual 9.3
20s 9.2
establishment 9
new 8.9
home 8.8
diversity 8.6
smile 8.5
educator 8.5
two 8.5
finance 8.4
presentation 8.4
horizontal 8.4
technology 8.2
cheerful 8.1
hall 8.1
handsome 8
day 7.8
happiness 7.8
diverse 7.8
portrait 7.8
corporation 7.7
class 7.7
ethnic 7.6
adults 7.6
holding 7.4
back 7.3
success 7.2
board 7.2
lifestyle 7.2
looking 7.2
center 7.2

Google
created on 2022-03-05

Chair 81.7
Font 79.5
Adaptation 79.4
Art 76.5
Room 71
Suit 70.9
Table 69.6
Monochrome 67.1
Event 66.6
History 65.6
Paper product 65.5
Monochrome photography 64.5
Stock photography 63.7
Visual arts 62.9
Photographic paper 61.5
Vintage clothing 60.6
Illustration 60.3
Sitting 59.4
Paper 55.7
Advertising 54.1

Microsoft
created on 2022-03-05

text 99.7
black and white 86.4
person 85.2
clothing 83.8
table 83.7
chair 77.3
furniture 73.8
white 64
people 58

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 60.1%
Sad 97.3%
Calm 1.2%
Disgusted 0.5%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 98.4%
Calm 94.2%
Sad 1.5%
Happy 1.3%
Disgusted 0.8%
Confused 0.7%
Angry 0.6%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 41-49
Gender Male, 95.8%
Calm 95%
Sad 2.9%
Confused 0.7%
Angry 0.4%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.1%
Calm 98.2%
Sad 1.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 88.1%
Sad 53.2%
Calm 41.1%
Happy 2.5%
Angry 1.3%
Confused 0.6%
Disgusted 0.6%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 52-60
Gender Male, 98.3%
Calm 65.4%
Sad 25.5%
Happy 3.8%
Disgusted 2.8%
Surprised 0.8%
Angry 0.6%
Confused 0.6%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 97.1%
Sad 64.4%
Fear 11.5%
Calm 8.3%
Happy 7.4%
Confused 3.3%
Disgusted 2.2%
Surprised 1.8%
Angry 1.1%

AWS Rekognition

Age 49-57
Gender Male, 98%
Calm 98.6%
Sad 1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 84%
Sad 30.6%
Calm 24.6%
Happy 24.1%
Fear 7.6%
Confused 6%
Disgusted 3.8%
Angry 1.9%
Surprised 1.4%

AWS Rekognition

Age 23-33
Gender Female, 93.7%
Calm 96.5%
Happy 1.6%
Confused 0.9%
Surprised 0.3%
Sad 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 100%
Person 98.1%

Captions

Microsoft

a group of people standing in front of a building 83.4%
a group of people sitting at a table in front of a building 78.7%
a group of people in front of a building 78.6%

Text analysis

Amazon

BUILDERS
RHOMBERG
5
LAC
SAFETY
ON
SAFETY FILM
FILM
CAA
ET
I
BROS.
Ben
IM
"
! ! !
OIS F

Google

ס( LAC RHOMBERG BROS BUILDERS * O RAK S:A E E I Y E! M K O !
RHOMBERG
BROS
RAK
S:A
Y
M
E
K
BUILDERS
O
ס(
I
LAC
*
E!
!