Human Generated Data

Title

Untitled (group portrait surrounded by speakers)

Date

1920s

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1749

Human Generated Data

Title

Untitled (group portrait surrounded by speakers)

People

Artist: John Deusing, American active 1940s

Date

1920s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99.4
Person 98.8
Person 98.7
Person 98.3
Clothing 95.3
Apparel 95.3
Accessory 93.5
Tie 93.5
Accessories 93.5
Indoors 91.5
Interior Design 91.5
Architecture 87.2
Clock Tower 87.2
Building 87.2
Tower 87.2
Floor 84.7
People 74.6
Room 74.2
Face 67.6
Portrait 66
Photography 66
Photo 66
Female 61.8
Child 61.6
Kid 61.6
Shorts 60.6
Text 60.6
Girl 58.6
Shoe 56.8
Footwear 56.8
Door 56
Person 47.1

Imagga
created on 2021-12-14

clock 26.8
man 22.2
shop 20.6
people 20.1
wall clock 19.6
barbershop 18.2
timepiece 17.7
room 16.6
old 16
person 15.9
business 13.3
city 13.3
retro 13.1
mercantile establishment 12.7
vintage 12.4
portrait 12.3
urban 12.2
men 12
adult 11.9
nurse 11.6
black 11.4
male 11.3
wall 11.1
antique 10.4
ancient 10.4
house 10
life 9.7
instrument 9.5
light 9.3
building 9.2
aged 9
family 8.9
home 8.8
happy 8.8
measuring instrument 8.7
analog clock 8.7
scene 8.6
architecture 8.6
grunge 8.5
place of business 8.5
travel 8.4
human 8.2
time 8.2
case 8.2
dress 8.1
decoration 8.1
art 8.1
group 8
worker 8
hospital 8
interior 8
window 8
women 7.9
mother 7.6
world 7.6
style 7.4
device 7.2
iron lung 7.2
holiday 7.2
team 7.2
history 7.1
smile 7.1
work 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.5
clothing 86
person 85.4
drawing 57.4
posing 50

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Female, 51.8%
Calm 33.2%
Happy 31.9%
Sad 29.6%
Angry 4%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 22-34
Gender Female, 51.6%
Sad 46.9%
Happy 32.7%
Calm 14%
Angry 4.3%
Fear 0.7%
Confused 0.6%
Surprised 0.4%
Disgusted 0.4%

AWS Rekognition

Age 24-38
Gender Male, 64.6%
Happy 65.6%
Calm 24.2%
Sad 8.6%
Angry 0.7%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Female, 57%
Happy 75.5%
Calm 11.4%
Sad 7.4%
Angry 4%
Surprised 0.6%
Confused 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 50-68
Gender Male, 94.6%
Calm 85.4%
Sad 11.2%
Happy 1.4%
Confused 1.2%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 36-52
Gender Male, 62.8%
Happy 57.4%
Calm 37.9%
Sad 3.4%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 36-54
Gender Male, 67.4%
Sad 71.5%
Happy 23.7%
Calm 3.6%
Fear 0.3%
Surprised 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 93.5%
Clock Tower 87.2%
Shoe 56.8%

Captions

Microsoft

a group of people posing for a photo 80.6%
a group of people posing for the camera 80.5%
a group of people posing for a picture 80.4%

Text analysis

Amazon

PLA-MOR
33%
-
NET
RORE
PROFT NET
MIKITE
MIKITE SENTORY
SENTORY
PROFT

Google

MA0O
PLA-MOR
YT3RA2
MA0O YT3RA2 MAMTRA3 MORE PLA-MOR
MAMTRA3
MORE