Human Generated Data

Title

Untitled (group of Muslim men playing a game)
Date

1862-1863
People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.59

Human Generated Data

Title

Untitled (group of Muslim men playing a game)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.59

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 99.3
Person 99.1
Person 99.1
Person 97
Turban 96.2
Headband 96.2
Hat 96.2

Clarifai
created on 2023-10-26

people 100
group 99.2
veil 98.8
adult 98.6
child 97
two 96.3
man 96.2
wear 95.5
three 95.2
four 94.1
portrait 93.9
leader 92.6
religion 91.6
son 90.8
woman 90.4
five 89.5
kneeling 88.6
group together 87.9
several 87.4
gown (clothing) 87.4

Imagga
created on 2022-01-23

person 34.7
man 25.5
people 18.4
couple 18.3
dress 18.1
male 17.8
ballplayer 17.7
ruler 16.7
bride 16.3
adult 15.9
white 14.8
athlete 14.5
player 14.4
wedding 13.8
portrait 13.6
old 13.2
contestant 12.6
scholar 12.3
love 11.8
world 11.6
senior 11.2
happiness 11
face 10.6
groom 10.1
happy 10
statue 9.9
intellectual 9.8
family 9.8
bouquet 9.4
church 9.2
religion 9
one 9
romantic 8.9
new 8.9
married 8.6
art 8.6
religious 8.4
monument 8.4
clothing 8.4
aged 8.1
sculpture 8.1
business 7.9
color 7.8
costume 7.8
father 7.7
wall 7.7
culture 7.7
two 7.6
gown 7.4
room 7.3
lifestyle 7.2
black 7.2
paper 7.2
history 7.2
summer 7.1

Google
created on 2022-01-23

Sleeve 87.2
Tints and shades 74.9
Vintage clothing 71.7
Art 70.4
Room 67.8
Rectangle 67.5
Stock photography 65.7
Font 60.6
Sitting 59.4
Hat 55.6
History 52

Microsoft
created on 2022-01-23

clothing 96
person 95.4
human face 92.2
text 89.2
old 80.6
man 72.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 82.5%
Sad 15.1%
Confused 1%
Surprised 0.4%
Happy 0.4%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 97%
Calm 99.3%
Sad 0.4%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 98.6%
Sad 64.4%
Calm 31.1%
Confused 2.2%
Disgusted 0.6%
Fear 0.6%
Angry 0.5%
Happy 0.4%
Surprised 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.4%
Calm 95.2%
Sad 3.9%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Sad 64.1%
Calm 32.4%
Happy 0.7%
Angry 0.7%
Confused 0.7%
Surprised 0.7%
Fear 0.5%
Disgusted 0.3%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.3%
Person 99.1%
Person 99.1%
Person 97%

Categories

Imagga

paintings art 99.2%

Text analysis

Amazon

1109
Photo 1109
Photo