Human Generated Data

Title

The "Marques" family complete? plus 1 sis-in-law!

Date

1910s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2173

Human Generated Data

Title

The "Marques" family complete? plus 1 sis-in-law!

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2173

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Person 97.4
Person 96.8
Person 96.5
Clothing 85.6
Apparel 85.6
People 82.3
Person 78.2
Person 77.6
Person 76.3
Art 74
Overcoat 72
Coat 72
Tie 63.2
Accessories 63.2
Accessory 63.2
Wood 60.9
Suit 57.5
Text 57.1
Painting 55.6
Flooring 55.2

Clarifai
created on 2023-10-15

people 99.9
group 99.8
family 99
woman 98.3
portrait 98.2
adult 97.9
offspring 97.9
child 97
three 96.3
art 96.2
leader 96
wear 95
man 94.6
son 93.5
princess 93.5
painting 93
elderly 92.2
royalty 92
retro 91.7
room 91.5

Imagga
created on 2021-12-15

kin 44
brass 19
man 17.5
people 17.3
old 16.7
male 15.6
wind instrument 14.7
person 14.2
architecture 13.3
home 12.7
family 12.4
building 12.4
couple 12.2
happy 11.9
vintage 11.6
musical instrument 11.5
adult 11.3
wall 11.1
women 11.1
portrait 11
happiness 11
city 10.8
history 10.7
statue 10.4
window 10.4
monument 10.3
black 10.2
office 9.9
fashion 9.8
world 9.3
house 9.2
historic 9.2
art 9.1
tourism 9.1
bride 8.9
businessman 8.8
antique 8.8
urban 8.7
sculpture 8.7
ancient 8.6
men 8.6
business 8.5
historical 8.5
grandfather 8.4
nurse 8.1
room 8
culture 7.7
stone 7.6
human 7.5
one 7.5
outdoors 7.5
exterior 7.4
street 7.4
group 7.2
child 7.2
dress 7.2
barbershop 7.2
smile 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

clothing 99.5
person 99.3
wall 99
smile 94.6
woman 94.1
man 92.7
gallery 91.9
old 87
posing 86.7
standing 84.9
text 84.6
room 78.2
human face 75.1
vintage clothing 56.2
footwear 53.5
child 53.2
picture frame 47.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 8-18
Gender Female, 50.6%
Happy 89.4%
Calm 8.9%
Surprised 0.6%
Angry 0.4%
Confused 0.2%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 12-22
Gender Male, 68.6%
Calm 62.9%
Happy 12.6%
Sad 11.5%
Angry 5.5%
Fear 3.5%
Confused 2.3%
Disgusted 0.8%
Surprised 0.8%

AWS Rekognition

Age 5-15
Gender Male, 91.6%
Happy 51.4%
Calm 39.2%
Surprised 3%
Sad 2.3%
Confused 2.1%
Fear 0.9%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 1-7
Gender Male, 84%
Calm 55.5%
Sad 17.3%
Fear 14.1%
Surprised 7.4%
Confused 2.7%
Angry 2.3%
Disgusted 0.6%
Happy 0.1%

AWS Rekognition

Age 38-56
Gender Male, 98.7%
Calm 54.8%
Angry 25.9%
Sad 8.3%
Fear 6.9%
Surprised 1.7%
Confused 1.2%
Happy 0.8%
Disgusted 0.5%

AWS Rekognition

Age 17-29
Gender Male, 61.7%
Calm 95.9%
Surprised 1.4%
Angry 0.8%
Happy 0.6%
Sad 0.6%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Female, 93.3%
Sad 36.5%
Calm 36.3%
Surprised 22%
Fear 3.7%
Confused 0.5%
Angry 0.4%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 0-3
Gender Male, 87%
Surprised 41.9%
Calm 33.2%
Fear 8.7%
Confused 7.5%
Sad 4.5%
Happy 1.9%
Angry 1.4%
Disgusted 0.8%

AWS Rekognition

Age 13-23
Gender Female, 79.8%
Calm 98.3%
Sad 0.6%
Angry 0.4%
Surprised 0.2%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 63.2%

Text analysis

Amazon

The
plus
1.50
/
amily
Sis
The "Marques J amily Complete? plus / Sis in law!
law!
in
Complete?
"Marques
J