Human Generated Data

Title

Untitled (group of men posed inside)

Date

1949

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18283

Human Generated Data

Title

Untitled (group of men posed inside)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Shorts 99.9
Clothing 99.9
Apparel 99.9
Chair 99.7
Furniture 99.7
Human 99.2
Person 99.2
Person 98.9
Person 98.7
Person 98.3
Person 97.8
Person 97.5
Person 96.4
Person 94.1
Person 93.9
Person 93.5
Person 92.6
Person 91.9
Person 91
Person 90
Accessories 89.4
Accessory 89.4
Tie 89.4
Indoors 88.5
Footwear 85.9
Shoe 85.9
Room 81.5
Person 79.9
People 78.8
Overcoat 77.4
Coat 77.4
Floor 76.4
Stage 76.1
Person 61.9
Female 61.2
Couch 58.9
Child 57.3
Kid 57.3
Dress 57.2
Crowd 56.7
Meal 56.4
Food 56.4
Suit 53.2

Imagga
created on 2022-03-04

athlete 100
runner 100
contestant 76.2
person 52.7
people 30.1
male 27.6
man 27.5
sport 25.7
silhouette 23.2
run 23.1
group 22.6
competition 20.1
men 19.7
adult 19.6
active 18.4
fitness 17.2
lifestyle 15.9
exercise 15.4
couple 14.8
happy 14.4
women 14.2
team 13.4
boy 13
together 12.3
action 12
black 12
human 12
weight 11.9
crowd 11.5
running 11.5
ball 11.4
fashion 11.3
attractive 11.2
body 11.2
fit 11
business 10.9
model 10.9
jogging 10.8
businessman 10.6
race 10.5
success 10.5
outdoors 10.4
motion 10.3
child 10.2
training 10.2
dancer 10
athletics 9.8
fun 9.7
style 9.6
track 9.6
healthy 9.4
youth 9.4
sports equipment 9.3
casual 9.3
dumbbell 9.3
pose 9.1
summer 9
sunset 9
recreation 9
family 8.9
grass 8.7
pretty 8.4
field 8.4
dress 8.1
copy space 8.1
equipment 8
posing 8
dance 7.9
love 7.9
happiness 7.8
compete 7.8
portrait 7.8
boys 7.7
party 7.7
clothing 7.7
outdoor 7.6
beach 7.6
friends 7.5
friendship 7.5
leisure 7.5
teamwork 7.4
street 7.4
speed 7.3
teenager 7.3
girls 7.3
professional 7.2
sexy 7.2
modern 7

Google
created on 2022-03-04

Black 89.5
Font 81.4
Snapshot 74.3
Event 72.3
Team 70.1
Monochrome 69.8
Crew 69.5
Suit 69.1
Monochrome photography 67.5
Room 62.3
History 61.4
Sitting 59.1
Uniform 54.8
Rectangle 54.3
Chair 53
Class 52.7
Player 52.7
Shorts 52.2
Team sport 50.5

Microsoft
created on 2022-03-04

text 99.9
person 95.3
clothing 86.6
man 83
black and white 80
posing 67.4
group 62.7
line 19.3

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 59.3%
Happy 12.7%
Surprised 6.5%
Sad 6.4%
Confused 6.1%
Disgusted 3.8%
Angry 2.8%
Fear 2.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 95.5%
Sad 2.1%
Disgusted 0.6%
Happy 0.5%
Confused 0.5%
Surprised 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 95.2%
Calm 54%
Surprised 25.6%
Sad 13.2%
Confused 2.6%
Happy 1.5%
Disgusted 1.5%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Sad 49.9%
Angry 25%
Calm 20.1%
Surprised 1.3%
Fear 1.2%
Disgusted 1.2%
Confused 0.7%
Happy 0.7%

AWS Rekognition

Age 42-50
Gender Male, 99%
Sad 54.2%
Calm 29.7%
Angry 10.9%
Surprised 2.6%
Fear 1.1%
Disgusted 0.6%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Confused 37.9%
Calm 29.4%
Surprised 13.6%
Sad 9.8%
Angry 4.2%
Disgusted 2.5%
Fear 1.8%
Happy 0.8%

AWS Rekognition

Age 49-57
Gender Male, 99.1%
Sad 67.1%
Confused 19.9%
Calm 4.2%
Surprised 4%
Disgusted 1.7%
Angry 1.7%
Fear 0.9%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 74.5%
Calm 9.3%
Confused 5.7%
Happy 4.8%
Surprised 2.4%
Angry 1.4%
Disgusted 1.3%
Fear 0.6%

AWS Rekognition

Age 50-58
Gender Male, 99.2%
Sad 98.9%
Confused 0.2%
Happy 0.2%
Disgusted 0.2%
Calm 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 80.2%
Sad 15.1%
Fear 1.2%
Surprised 0.8%
Angry 0.8%
Happy 0.7%
Confused 0.6%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 89.4%
Shoe 85.9%
Suit 53.2%

Captions

Microsoft

a group of people posing for a photo 93.7%
a group of people posing for the camera 93.6%
a group of people posing for a picture 93.5%

Text analysis

Amazon

FIRST NATIONAL
THE
MEMORIAM
BANK
UN MEMORIAM
YT33AS
UN

Google

XAGO
YT33A2 XAGO
YT33A2