Human Generated Data

Title

Untitled (businesspeople in Mercantile Exchange auditorium)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15950

Human Generated Data

Title

Untitled (businesspeople in Mercantile Exchange auditorium)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15950

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 98.6
Human 98.6
Person 98
Person 97.3
Person 97
Person 94
Indoors 93.7
Person 93.4
Person 93.3
Cafeteria 90.2
Restaurant 90.2
Person 89
Person 88.1
Person 85.5
Person 74.4
Person 74.4
Furniture 71.1
Person 68.1
Room 65.8
Office 63.4
Building 63.3
Person 62.9
Person 57.2
Lab 56.6
Library 56.1
Book 56.1
Person 49.7

Clarifai
created on 2023-10-29

people 98.5
classroom 98.4
indoors 98.3
desk 98.2
room 98.1
education 98.1
furniture 98
school 97.8
chair 97.4
monochrome 96.3
seat 95.5
group 94.8
man 94
teacher 93.6
interior design 93.4
sit 92
adult 91.6
woman 91.5
no person 88.3
university 87.3

Imagga
created on 2022-03-25

room 83.1
classroom 68.9
interior 52.2
library 38
building 37.6
table 35.1
chair 34.5
modern 31.6
restaurant 30.4
furniture 29.3
center 28.8
house 28.4
structure 26.9
design 25.9
home 24.7
indoors 23.7
decor 23
kitchen 22.5
window 20.6
indoor 20.1
wood 19.2
dining 19
chairs 18.6
empty 17.2
office 16.8
floor 16.7
light 16.7
decoration 15.9
tables 15.8
architecture 15.6
style 15.6
glass 15.6
luxury 14.6
nobody 14
shop 14
inside 13.8
dinner 13.5
food 13.4
lamp 13.3
cafeteria 13.3
contemporary 13.2
wall 12.8
business 12.8
counter 12.6
apartment 12.5
comfortable 12.4
seat 11.9
work 11.8
blackboard 11.8
drink 11.7
bar 11.1
stool 10.9
cabinet 10.8
stove 10.8
people 10.6
hotel 10.5
urban 10.5
plant 10.5
elegance 10.1
3d 10.1
coffee 9.3
service 9.3
school 9.2
city 9.1
hall 8.9
computer 8.9
steel 8.8
oven 8.8
sink 8.8
tile 8.7
residential 8.6
living 8.5
place 8.4
lights 8.3
mercantile establishment 8.3
equipment 8.2
desk 8.2
domestic 8.1
man 8.1
success 8
metal 8
refrigerator 7.9
education 7.8
scene 7.8
render 7.8
space 7.8
sofa 7.7
decorate 7.6
new 7.3
stylish 7.2
lifestyle 7.2
day 7.1
life 7

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

text 99.1
furniture 95.7
indoor 94
table 91.3
person 89.9
building 84.4
people 80.9
desk 80.2
chair 79.3
office building 79
computer 78.9
classroom 50.7
crowd 0.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Surprised 92.1%
Sad 3%
Confused 1.6%
Fear 1%
Angry 0.8%
Disgusted 0.6%
Calm 0.6%
Happy 0.3%

AWS Rekognition

Age 54-64
Gender Male, 100%
Confused 88.5%
Calm 4.1%
Happy 2.9%
Sad 1.8%
Angry 1%
Disgusted 1%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.7%
Calm 65.4%
Surprised 15.6%
Confused 11.6%
Disgusted 3.1%
Angry 2.2%
Happy 0.9%
Fear 0.7%
Sad 0.6%

AWS Rekognition

Age 21-29
Gender Male, 93.3%
Calm 63.5%
Sad 15%
Fear 10.2%
Happy 3.5%
Disgusted 2.3%
Angry 2.3%
Surprised 2%
Confused 1.1%

AWS Rekognition

Age 12-20
Gender Female, 94.7%
Calm 76.4%
Sad 12.6%
Surprised 7.4%
Disgusted 0.9%
Confused 0.9%
Fear 0.8%
Happy 0.5%
Angry 0.5%

AWS Rekognition

Age 20-28
Gender Male, 67.4%
Calm 63.3%
Confused 18.6%
Sad 5.4%
Surprised 4.1%
Disgusted 3%
Angry 2.3%
Happy 1.7%
Fear 1.6%

AWS Rekognition

Age 37-45
Gender Male, 99.6%
Sad 50.7%
Happy 13.1%
Disgusted 12.5%
Fear 9%
Calm 7.9%
Angry 4.6%
Surprised 1.2%
Confused 0.9%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Sad 45.4%
Surprised 18.5%
Fear 14.1%
Calm 8.4%
Confused 5.2%
Angry 4.1%
Disgusted 3.5%
Happy 0.7%

AWS Rekognition

Age 66-76
Gender Female, 95.1%
Calm 97%
Confused 1%
Fear 0.8%
Surprised 0.5%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Male, 98.8%
Calm 68.4%
Sad 13.7%
Confused 11.6%
Happy 2.8%
Disgusted 1.6%
Fear 0.8%
Surprised 0.6%
Angry 0.5%

AWS Rekognition

Age 30-40
Gender Male, 85.7%
Calm 79.3%
Happy 9.8%
Confused 3.4%
Sad 3.2%
Disgusted 1.7%
Surprised 1.4%
Angry 0.6%
Fear 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.7%
Calm 90.4%
Happy 4.1%
Sad 2.5%
Confused 0.9%
Fear 0.7%
Disgusted 0.7%
Angry 0.3%
Surprised 0.3%

AWS Rekognition

Age 18-26
Gender Male, 96.1%
Fear 85.4%
Happy 3.9%
Calm 3.9%
Sad 3.2%
Disgusted 1.3%
Angry 0.9%
Confused 0.8%
Surprised 0.5%

AWS Rekognition

Age 12-20
Gender Male, 93.3%
Sad 63.2%
Confused 34.2%
Angry 0.8%
Disgusted 0.7%
Calm 0.6%
Surprised 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 90.9%
Calm 93.1%
Sad 1.9%
Disgusted 1.8%
Confused 1.1%
Happy 1%
Angry 0.6%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Female, 54.5%
Calm 71%
Angry 8.2%
Confused 7.5%
Sad 5%
Happy 3.6%
Fear 1.7%
Surprised 1.5%
Disgusted 1.4%

AWS Rekognition

Age 20-28
Gender Male, 97.3%
Sad 29.2%
Happy 26.7%
Calm 16.4%
Confused 8.3%
Disgusted 7.1%
Angry 5.4%
Fear 5.1%
Surprised 1.8%

AWS Rekognition

Age 43-51
Gender Male, 95.3%
Calm 77.1%
Confused 7.2%
Angry 6.8%
Happy 3.2%
Sad 2.9%
Surprised 1.8%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 13-21
Gender Male, 98.4%
Calm 69%
Sad 12.2%
Fear 6.4%
Disgusted 6.2%
Angry 2.7%
Happy 1.4%
Confused 1.4%
Surprised 0.7%

AWS Rekognition

Age 31-41
Gender Female, 86%
Sad 77.5%
Confused 5.2%
Surprised 3.6%
Calm 3.5%
Happy 3.4%
Fear 2.6%
Angry 2.1%
Disgusted 2.1%

AWS Rekognition

Age 12-20
Gender Male, 86.8%
Calm 68.1%
Sad 19.8%
Happy 4.1%
Angry 2.9%
Confused 1.6%
Fear 1.5%
Surprised 1.1%
Disgusted 0.9%

AWS Rekognition

Age 13-21
Gender Female, 97.3%
Calm 58.5%
Sad 21.2%
Angry 5.5%
Happy 5.1%
Fear 4.2%
Confused 2.4%
Surprised 1.8%
Disgusted 1.2%

AWS Rekognition

Age 28-38
Gender Male, 88.1%
Calm 42.3%
Sad 26.7%
Happy 23.7%
Confused 2.3%
Disgusted 2.1%
Angry 1.1%
Surprised 1%
Fear 0.8%

AWS Rekognition

Age 28-38
Gender Male, 56.9%
Disgusted 93.8%
Calm 3.5%
Sad 1.6%
Happy 0.4%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.1%
Sad 52.8%
Confused 28.6%
Angry 8.9%
Calm 4%
Disgusted 3.7%
Surprised 1%
Happy 0.6%
Fear 0.5%

AWS Rekognition

Age 18-26
Gender Female, 65.5%
Calm 40.1%
Sad 39.7%
Confused 12.6%
Happy 3.8%
Fear 1.3%
Angry 1.1%
Disgusted 0.7%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.6%
Person 98%
Person 97.3%
Person 97%
Person 94%
Person 93.4%
Person 93.3%
Person 89%
Person 88.1%
Person 85.5%
Person 74.4%
Person 74.4%
Person 68.1%
Person 62.9%
Person 57.2%
Person 49.7%

Categories

Imagga

interior objects 99.9%

Text analysis

Amazon

KODAK
11
KODAK SAFETY FILM
SAFETY
FILM
I

Google

KODAK S'AFETY FILM KODAK
KODAK
S'AFETY
FILM