Human Generated Data

Title

Untitled (five-part portrait of a man)
Date

1910s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2908

Human Generated Data

Title

Untitled (five-part portrait of a man)

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2908

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.6
Person 99.2
Person 99.1
Person 96.5
Apparel 95.8
Clothing 95.8
Tie 94.2
Accessories 94.2
Accessory 94.2
People 87.3
Crowd 85.9
Suit 82.6
Coat 82.6
Overcoat 82.6
Attorney 82.6
Suit 78.5
Jury 77
Head 74
Sitting 70.7
Indoors 69.2
Room 69.2
Court 67.5
Face 61.9
Audience 59.4
Hat 58.7
Officer 56.3
Military 56.3
Military Uniform 56.3

Clarifai
created on 2023-10-25

people 100
group 99.7
adult 99.4
portrait 99.2
man 98.7
three 98.6
administration 98.3
leader 97.8
two 97.8
four 94.7
group together 94.6
wear 93
several 91.6
facial expression 88.8
furniture 86.8
retro 86.4
actor 85.1
outfit 83.8
scientist 83.3
chair 83.1

Imagga
created on 2022-01-08

groom 100
couple 41.8
man 41.6
person 34.3
male 34
people 31.2
love 28.4
adult 27.9
happiness 26.6
men 26.6
happy 25.7
suit 25.6
wedding 24.8
bride 24.1
smiling 22.4
smile 21.4
businessman 20.3
married 20.1
portrait 20
two 18.6
business 18.2
dress 18.1
marriage 18
handsome 17.8
family 16
women 15.8
together 15.8
husband 15.7
senior 15
sitting 14.6
professional 13.7
office 13.6
executive 13.3
wife 13.3
bouquet 13.2
cheerful 13
attractive 12.6
lifestyle 12.3
veil 11.7
gown 11.7
businessmen 11.7
meeting 11.3
corporate 11.2
celebration 11.2
mature 11.1
romance 10.7
romantic 10.7
old 10.4
tie 10.4
standing 10.4
pair 10.4
face 9.9
fashion 9.8
colleagues 9.7
indoors 9.7
looking 9.6
adults 9.5
pretty 9.1
black 9
team 9
group 8.9
home 8.8
30s 8.7
table 8.6
work 8.6
elderly 8.6
formal 8.6
elegant 8.6
relationship 8.4
look 7.9
day 7.8
hands 7.8
bridal 7.8
affectionate 7.7
outdoors 7.5
future 7.4
park 7.4
confident 7.3
aged 7.2
sexy 7.2
building 7.1
necktie 7.1

Google
created on 2022-01-08

Clothing 98.8
Face 98.3
Smile 96.5
Coat 87.7
Gesture 85.3
Suit 80.2
Font 78
Snapshot 74.3
Event 73.8
Vintage clothing 73.7
Classic 72.6
Blazer 72.4
Formal wear 72
Fun 69
Room 68.2
Crew 68.2
Team 67.7
White-collar worker 67.5
History 67.1
Monochrome 63.7

Microsoft
created on 2022-01-08

person 99.1
clothing 98.1
human face 97.7
text 96.1
man 94.8
smile 90.8
posing 68.2
old 64.4
photograph 59.4
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 67.7%
Happy 12%
Angry 6.5%
Sad 5%
Confused 3.5%
Fear 2.2%
Disgusted 1.8%
Surprised 1.2%

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 48.6%
Happy 30.6%
Angry 7.9%
Confused 4.3%
Sad 3.3%
Disgusted 2.6%
Surprised 1.4%
Fear 1.3%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 99.8%
Happy 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Fear 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 94.2%
Suit 82.6%

Categories

Imagga

paintings art 79.2%
people portraits 17.1%
food drinks 3.2%