Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsh Fund.: 14. A Family Group of Partly Americanized Russian Immigrants.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.2

Human Generated Data

Title

Races, Jews: United States. New Jersey. Woodbine. Baron de Hirsch Agricultural and Industrial School: Woodbine Settlement and School, Woodbine, N.J. Baron de Hirsh Fund.: 14. A Family Group of Partly Americanized Russian Immigrants.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.136.2

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 99.8
Person 99.8
Person 99.6
Person 99.4
Person 99.2
Person 93
Clinic 87.7
Nature 87.4
Building 72.3
Rural 72.3
Countryside 72.3
Outdoors 72.3
Shelter 72.3
Painting 64.3
Art 64.3
Hospital 59.4
Room 56.3
Indoors 56.3
Poster 55.9
Advertisement 55.9

Clarifai
created on 2018-04-18

people 99.8
adult 99.1
man 97.3
indoors 96.9
woman 96
wear 94.4
two 92
military 91.9
furniture 91.6
group 89.4
offense 89
sit 88.2
one 87.4
room 85.8
administration 84.3
child 84.1
side view 83.5
leader 80.7
ceremony 77.3
music 77.1

Imagga
created on 2018-04-18

brass 68.1
memorial 59.2
structure 44
business 17.6
old 17.4
man 15.4
money 12.8
financial 12.5
currency 11.7
people 11.1
art 11
office 10.7
male 10.6
finance 10.1
banking 10.1
light 10.1
cash 10.1
history 9.8
one 9.7
ancient 9.5
bill 9.5
portrait 9.1
black 9
computer 9
bank 8.9
television 8.9
sculpture 8.7
wall 8.7
laptop 8.5
senior 8.4
vintage 8.3
historic 8.2
aged 8.1
symbol 8.1
water 8
home 8
marble 8
interior 8
businessman 7.9
paper 7.9
person 7.8
antique 7.8
statue 7.6
room 7.6
historical 7.5
monument 7.5
desk 7.4
dollar 7.4
economy 7.4
furniture 7.4
indoor 7.3
looking 7.2

Google
created on 2018-04-18

photograph 96.3
text 91.3
snapshot 81.8
vintage clothing 76.8
history 63.4
font 60.2
stock photography 56.9
picture frame 55
paper product 51.9

Microsoft
created on 2018-04-18

text 95.7
businesscard 21.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 97.8%
Calm 11.8%
Surprised 4.2%
Happy 2.1%
Sad 38.3%
Disgusted 15.4%
Angry 19.3%
Confused 8.8%

AWS Rekognition

Age 26-43
Gender Female, 54%
Surprised 45.1%
Disgusted 45.1%
Confused 45.3%
Calm 53.7%
Happy 45.1%
Angry 45.3%
Sad 45.4%

AWS Rekognition

Age 15-25
Gender Male, 51.5%
Disgusted 45.7%
Happy 45.8%
Sad 46.8%
Calm 49.3%
Angry 46.2%
Confused 45.5%
Surprised 45.8%

AWS Rekognition

Age 11-18
Gender Female, 54.4%
Disgusted 45.9%
Calm 47.5%
Sad 49.3%
Angry 46.2%
Confused 45.2%
Happy 45.4%
Surprised 45.6%

AWS Rekognition

Age 30-47
Gender Male, 80.4%
Confused 16%
Sad 29.3%
Surprised 14.8%
Happy 7%
Disgusted 4.5%
Angry 5.9%
Calm 22.5%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 64.3%
Poster 55.9%

Captions

Microsoft
created on 2018-04-18

an old photo of a person 64.3%
an old photo of a person 63.1%
old photo of a person 59.9%

Text analysis

Amazon

Group
Immigrants.
Russiay
Mmericaniged
Partly
Fawily
14.
14. A Fawily Group o Partly Mmericaniged
A
i
o

Google

14 Rassiay Immigrants
Rassiay
14
Immigrants