Human Generated Data

Title

Untitled (group portait of men posing inside courthouse room)
Date

1938
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10957

Human Generated Data

Title

Untitled (group portait of men posing inside courthouse room)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 98.7
Human 98.7
Person 98.7
Person 98
Person 97.4
Person 96.7
Person 96.7
Person 95.5
Person 95
Person 95
Person 94.8
Person 94.6
Person 92.4
Floor 91.8
Person 88.2
People 87.5
Person 83.3
Person 82
Indoors 81.9
Room 81
Person 78.3
Person 75.5
Photo 70.6
Portrait 70.6
Photography 70.6
Face 70.6
Stage 68.5
Person 64.9
Person 61.4
Flooring 59.5

Imagga
created on 2022-02-05

grunge 23.8
vintage 21.5
old 19.5
graffito 19.4
art 18.1
black 17.4
silhouette 17.4
decoration 17.3
structure 17.2
texture 16.7
dark 15.9
antique 15.7
ancient 15.6
aged 15.4
dirty 15.4
design 13.1
artistic 13
graphic 12.4
retro 11.5
text 11.3
person 11.3
people 11.2
style 11.1
man 10.8
city 10.8
grungy 10.4
architecture 10.2
building 10.2
grain 10.2
wallpaper 10
night 9.8
pattern 9.6
old fashioned 9.5
symbol 9.4
world 9.4
historic 9.2
sign 9
sculpture 9
material 8.9
blackboard 8.9
grime 8.8
crumpled 8.7
horror 8.7
mystery 8.6
paper 8.6
damaged 8.6
culture 8.5
space 8.5
frame 8.5
travel 8.4
billboard 8.4
wall 8.3
artwork 8.2
landscape 8.2
drawing 8.2
paint 8.1
religion 8.1
history 8
evil 7.8
freight car 7.7
sky 7.7
power 7.6
historical 7.5
light 7.3
group 7.3
textured 7

Google
created on 2022-02-05

Human body 88.5
Art 80.4
Sports uniform 77.5
Rectangle 76.9
Font 76
Player 75.3
Painting 74.2
Team 70.6
Illustration 69.7
Team sport 68.8
Room 66.9
Visual arts 66.7
Sports 66.4
Ball game 64.1
Paper product 64.1
Uniform 62.3
Sketch 61.4
Soccer 60.1
Sport venue 56.6
Paper 56.5

Microsoft
created on 2022-02-05

text 98.8
person 92.6
clothing 72.3
man 69.1

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Calm 89.7%
Happy 3.2%
Sad 2.5%
Confused 1.4%
Angry 1.2%
Disgusted 1.1%
Surprised 0.7%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 96.7%
Calm 90.9%
Sad 8%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.1%
Calm 90.8%
Sad 7.5%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 91.1%
Happy 89%
Calm 9%
Sad 0.7%
Disgusted 0.5%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 90.4%
Calm 96.8%
Happy 2.1%
Sad 0.6%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 34-42
Gender Male, 98.2%
Calm 94%
Sad 1.4%
Confused 1.2%
Disgusted 1.2%
Happy 0.8%
Surprised 0.7%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 93.3%
Sad 3.9%
Disgusted 0.8%
Confused 0.5%
Fear 0.4%
Angry 0.4%
Surprised 0.3%
Happy 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Calm 98.4%
Sad 1.3%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Angry 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 43-51
Gender Male, 92.4%
Calm 83.3%
Happy 10.2%
Sad 4.1%
Confused 1.1%
Surprised 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 77.7%
Calm 98.1%
Sad 1.2%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 90.5%
Calm 47.9%
Sad 44%
Angry 3.4%
Fear 3%
Confused 0.6%
Disgusted 0.5%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Male, 85.1%
Calm 58.7%
Sad 38.8%
Happy 0.6%
Surprised 0.5%
Disgusted 0.5%
Confused 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 55.8%
Calm 95.2%
Sad 3.8%
Happy 0.4%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people in a room 82%
a group of people posing for a photo 62.3%
a group of people standing in a room 62.2%

Text analysis

Amazon

INSURANCE
CO
EL PEAROD CO
EL
PEAROD

Google

PEAY
117
111
CO
TA PEAY CO INSURANCE 117 111
TA
INSURANCE